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EXECUTIVE SUMMARY 



The Title I program began in 1965 as part of the Hkmentaiy and Secondary Education Act of 1965 (ESEL4) 
and is intended to help ensure that all children have the opportunity to obtain a high-quality education 
and reach proficiency on challenging state standards. The No Child Ceft Behind Act of 2001 (NCLBJ, 
which went into effect beginning with the 2002—03 school year, strengthened the assessment and 
accountability provisions of ESEA, while also creating new provisions related to parental choice and 
teacher quality. These and other changes were intended to increase the quality and effectiveness not only 
of the Title I program, but also of the entire elementary and secondary education system in raising the 
achievement of all students, particularly those with the lowest achievement levels. 

As part of the No Child Eeft Behind Act, Congress mandated a National Assessment of Tide I to evaluate 
the implementation and impact of the program, and the final report of the National Assessment was 
released in 2007. Because additional findings from Tide I evaluadon studies have become available, this 
report was prepared to provide a summary of these new findings. 

The report includes new data from the second round of data collecdon for the two studies that are the 
main data sources for this report: the Nadonal Longitudinal Study of NCEB, which surveyed districts, 
principals, teachers, and parents, and the Study of State Implementadon of Accountability and Teacher 
Quality Under NCEB, which interviewed state Tide I directors and compiled data from state 
administradve records. Both studies collected data in 2004—05 and 2006—07. The Nadonal Assessment 
of Tide I final report summarized findings from the 2004—05 data collecdon, while this report examines 
the 2006—07 data and reports on change between the two years, and also includes findings from an 
analysis of student achievement outcomes for Tide I school choice and supplemental educadonal 
services that was conducted for a small subsample of nine large urban districts. This new report also 
includes updated data from consolidated state performance reports, including student achievement on 
state assessments, school and district idendficadon for improvement, and highly qualified teachers, and 
addidonal state-reported data on schools’ AYP and improvement status. 

A. Trends in Student Achievement 

This report examines trends in student achievement for public school students using both state 
assessment data and the Nadonal Assessment of Educadonal Progress (NAEP). Student achievement 
on state assessments represents the primary criterion that the Tide I statute applies to measure school 
success, but these data cannot be aggregated across states to examine nadonal trends, because they vary 
in both the content and difficulty of test items as well as in the level that is labeled as “proficient.” The 
NAEP provides a high-quality assessment that is consistent across states, but is not aligned with 
individual state content and achievement standards, so it may not precisely measure what students are 
expected to learn in their states. This report examines recent trends on state assessments from 2004—05 
through 2006—07 in 30 states that had consistent assessments in place over this period and longer-term 
trends on the main NAEP assessment (1990 to 2007), with a focus on recent trends. 

These achievement trend data do not direcdy address the impact of NCEB, because it is difficult to 
separate the effects of NCEB from the effects of other state and local improvement efforts. 
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Are students whom Title I is intended to beneSt (including low-income students, racial 
and ethnic minorities, limited English proGcient (LEP) students, migrant students, and 
students with disabilities) making progress toward meeting state academic achievement 
standards in reading and mathematics? 

In 30 states that had trend data available from 2004—05 to 2006—07, the percentage of students 
achieving at or above the state’s proficient level rose for most student groups in a majority of the 
states. For example, state fourth-grade reading assessments show achievement gains for low-income 
students in 23 out of 27 states (85 percent) that had trend data available for this assessment. Across all 
student groups examined, states showed achievement gains in fourth-grade reading in 73 percent of the 
cases. Results for fourth-grade mathematics and eighth-grade reading and mathematics show similar 
patterns. 

However, none of the 30 states would meet the goal of 100 percent proficiency by 2013—14 unless 
the percentage of students achieving at the proficient level increased at a faster rate. For 

example, of the 27 states with consistent fourth-grade reading assessment data for low-income students, 
three states (11 percent) would meet the 100 percent goal by 2013—14 for this subgroup if they sustained 
the same rate of growth that they achieved from 2004—05 to 2006—07. Looking across eight different 
student groups (low-income, black, Hispanic, white, LEP, migrant, students with disabilities, and the 
“all students” group) and four assessments (reading and mathematics in fourth grade and eighth grade), 
an average of 16 percent of the student groups within the 30 states would be predicted to reach 100 
percent proficiency if recent growth rates were to continue. 

Are students, especially disadvantaged students, showing achievement gains on the 
National Assessment of Educational Progress? 

Recent trends on the main NAEP assessment showed gains for fourth-grade students in 
reading, mathematics, and science, overall and for minority students and students in high- 
poverty schools. For example, from 2002 to 2007, black and Hispanic students each gained five points 
in fourth-grade reading, compared with a three-point gain for white students. In fourth-grade math, 
black students gained 19 points from 2000 to 2007 and Hispanic students gained 20 points, again greater 
than the 15-point gain for white students. In fourth-grade science, black students gained seven points 
from 2000 to 2005 and Hispanic students gained 1 1 points, compared with a three-point gain for white 
students. 

Over the longer term, black and Hispanic students showed larger gains in mathematics (35 points and 28 
points, respectively, from 1990 to 2007) and reading (12 points and 10 points, respectively, from 1992 to 
2007). 

NAEP trends for middle and high school students were mixed. Eighth-grade students made 
significant gains in mathematics but not in reading or science. At the 12th-grade level, the most recent 
reading and science assessments, in 2005, showed no change from the preceding assessments (2002 for 
reading and 2000 for science) and showed significant declines from the first years those assessments 
were administered (1992 for reading and 1996 for science). Recent trend data for 12th-grade 
mathematics are not available. 
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Ate achievement gaps between disadvantaged students and other students closing over 
time? 



State assessments and NAEP both provided some indications that achievement gaps between 
disadvantaged students and other students may be narrowing. For example, on the NAEP fourth- 
grade reading assessment the black-white achievement gap declined from 29.3 scale score points in 2002 
to 26.6 points in 2007, a reduction of 2.7 points. Black-white achievement gaps also declined in fourth 
grade math from 2000 to 2007 (by four points) and in fourth-grade science from 2000 to 2005 (by four 
points) . The Hispanic-white achievement gap for fourth-grade students declined in both math and 
science (by five points and eight points, respectively) but showed no significant change in reading. 



B. Implementation of State Assessment and Accountability Systems 

To what extent have states implemented the annual assessments in reading, 
mathematics, and science that are required underl^CLIQ? 

As of Jan. 8, 2009, 39 state assessment systems had been approved by the Department, through a 
peer review process, as meeting all A^CZ,.6 testing requirements for reading and mathematics. 

For the remaining states, the evidence submitted indicated that one or more fundamental components 
were missing or did not meet the statutory and regulatory requirements, and reviews of their state 
assessment systems are continuing. During the 2005—06 school year, all states administered assessments 
intended to meet NCLB requirements for reading and mathematics. 

ATCLB did not require science assessments to be in place until 2007—08. Seven states had science 
assessments approved prior to May 2008 along with their reading and mathematics assessments; as of 
December 2008, 1 1 states had approved science assessments. 

In 2005—06, two-thirds of the states (36) met the requirement to annually assess 95 percent or 
more of their students, including major racial and ethnic groups, students with disabilities, limited 
English proficient (LEP) students, and low-income students. The remaining 1 6 states did not meet the 
minimum test participation requirement for one or more student subgroups. 

How many schools were identified for improvement unt/erNCLB and what were their 
characteristics? 

The number of Title I schools that were identified for improvement rose to 10,781 in 2006—07, 
an 11 percent increase over the 9,694 identified Title I schools in 2005—06. Twenty percent of all 
Tide I schools were identified in 2006—07, up from 19 percent in 2005—06 and 18 percent in 2004—05. 
The number and percentage of schools identified for improvement varied considerably across states: 
nine states had identified 5 percent or fewer of their Tide I schools, while 12 states had idendfied more 
than one-third of their Tide I schools. 

Most schools that have been identified for improvement are concentrated in a relatively small 
number of districts. Two-thirds (67 percent) of all Tide I identified schools were located in just 
3 percent of all Tide I districts; 47 percent of Tide I idendfied schools were located in 122 districts that 
had 13 or more idendfied schools, and 16 percent were located in the 15 school districts that had the 
largest numbers of idendfied schools. 
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Most schools that were identified for improvement in 2004-05 remained in improvement status 
two years later, in 2006—07. Nearly three-fourths of identified schools in 2004—05 continued to be 
identified schools in 2006—07, while 28 percent had exited school improvement status. About half of the 
2004—05 cohort of identified schools had moved into corrective action (25 percent) or restructuring 
status (22 percent) by 2006—07. 

Almost half of identified Title I schools were in the more advanced stages of identification 
status. Forty-six percent of all identified Tide I schools in 2006—07 were in either corrective action or 
restructuring, up from 33 percent in 2005—06 and 23 percent in 2004—05. The number of Title I schools 
in corrective action more than doubled from 1,223 in 2005—06 to 2,663 in 2006—07, while the number in 
restructuring status rose from 1,683 to 2,271. 

Schools with high concentrations of poor and minority students were much more likely to be 
identified than other schools, as were schools located in urban areas. Over one-third of high- 
poverty schools (37 percent) and schools with high percentages of minority students (38 percent) were 
identified schools in 2006—07, compared with 4 to 5 percent of schools with low concentrations of these 
students. Schools in urban areas were more likely to be identified (25 percent) than were suburban and 
mral schools (12 percent and 9 percent, respectively). Middle schools were more likely to be identified 
(22 percent of middle schools) than were high schools (13 percent) or elementary schools (14 percent). 

States have improved the timeliness of their notification to schools about school identification 
status, but some states continue to provide this notification well after the school year has begun. 

Forty-four states, the District of Columbia, and Puerto Rico notified schools of the preliminary 
determinations of their school improvement status for 2006—07 (based on 2005—06 testing) before 
September 2006, and 25 states provided final results by that time, up from 31 states and 15 states, 
respectively, in fall 2004. However, one state did not provide preliminary notifications until November 
or later, and 12 states did not provide final notifications until November or later. 

Principals and teachers were not always aware that their school had been identified as in need 
of improvement, although principal awareness has improved. In Title I schools that had been 
identified for improvement for 2006—07, 13 percent of principals incorrectly reported that their school 
had not been identified for improvement, an improvement from 22 percent in 2004—05 and 41 percent 
in 2001—02. Among teachers in identified Title I schools, 28 percent of elementary teachers and 36 
percent of secondary teachers were not aware that their school had been identified for improvement for 
2006—07, similar to the percentages for 2004—05 (30 percent and 37 percent, respectively). 

What are the reasons schools did not make adequate yearly progress (AYP)? 

Schools most commonly missed AYP for the achievement of the “all students” group or for 
multiple targets. Based on data from 43 states, among schools that missed AYP in 2005—06, 35 
percent did not meet achievement targets for the “all students” group in reading, mathematics, or both, 
and another 20 percent missed AYP for the achievement of two or more subgroups. About one-fourth 
(24 percent) missed AYP solely due to the achievement of a single subgroup. The remaining 21 percent 
missed for other combinations of targets. 

What assistance is provided to districts and schools identiGed for improvement? What 
interventions are implemented in these districts and schools? 

Schools that were identified for improvement were more likely to report needing and receiving 
assistance than were non-identified schools. For example, 77 percent of identified schools reported 
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needing technical assistance to improve the quality of professional development in 2006—07, compared 
with 53 percent of non-identified schools. On average, principals of identified schools reported 
receiving about eight days of technical assistance in 2005—06, compared with four days reported by 
principals of non-identified schools. 

The most common improvement strategies reported by identified schools involved using 
achievement data to inform instruction (88 percent) and providing additional instruction to 
low-achieving students (77 percent). Other common strategies included a major focus on aligning 
curricula and instruction with standards and assessments (81 percent), new instmctional approaches or 
curricula in reading and mathematics (66 percent and 64 percent, respectively), and increasing the 
intensity, focus, and effectiveness of professional development (63 percent). 

Most elementary teachers reported no change from 2004—05 to 2006—07 in the amount of 
instructional time that they spent on various subjects, based on a survey administered by the 
National Longitudinal Study of NCLB. About one-fifth of these teachers reported increasing the 
amount of time they spent on reading (22 percent) and mathematics (18 percent); few reported a 
decrease in time spent on these two subjects (3 to 4 percent). Twelve percent reported decreasing the 
amount of instructional time for science and social studies instruction, while 5 to 6 percent reported an 
increase; 82 to 83 percent reported no change in instructional time for these two subjects. Ninety 
percent of elementary teachers reported no change in time spent on art and music. In terms of minutes 
per week, elementary teachers reported average increases in reading and math instructional time of 21 
minutes and 10 minutes, respectively, and decreases in 3 minutes per week for science, 5 minutes for 
social studies and history, and 1 minute for art and music). 

The above findings about changes in instructional time present a different picture from those recendy 
reported by the Center on Education Policy (CEP) based on a survey of school districts conducted in 
2006—07. For example, CEP reported that 36 percent of all districts reported reducing instructional time 
in social studies since NCUi took effect in 2002, with an average decrease of 76 minutes per week in 
districts that reported such reductions. The CEP survey asked districts about change over a five-year 
period (2002 to 2007) while the National Longitudinal Study of ATCEB asked teachers about change over 
a two-year period (2004-05 to 2006-07). 

Most Title I schools in corrective action status in 2006—07 reported experiencing interventions 
that NCLB defines for such schools. The two most common corrective actions were less frequentiy 
reported in 2006—07 than in 2004—05: Tide I schools in correcdve acdon status were less likely to report 
being required to implement new curricula or instmcdonal programs (67 percent in 2006—07 vs. 89 
percent in 2004—05) or the appointment of an outside advisor (26 percent vs. 59 percent). In both years, 
fewer schools reported extending the length of the school day, restructuring the internal organizadon of 
the school, or replacing school staff members relevant to the school’s low performance (21 to 22 percent 
in 2006—07, with no significant change since 2004-05 for these three acdons). Overall, there was not a 
stadsdcaUy significant change in the percentage of correcdve acdon schools that reported experiencing at 
least one of the correcdve acdons listed in the law (88 percent in 2006—07 vs. 96 percent in 2004—05). 

Few Title I schools in restructuring status in 2006—07 reported experiencing any of the specific 
interventions listed in the law for this stage of improvement status, although they did frequently 
report other types of interventions. The most frequendy reported restructuring intervendon was 
replacement of all or most of the school staff (12 percent). Replacement of the principal, which is not 
specified in the law as a restructuring strategy, was reported by 40 percent of schools in restructuring 
status, compared with 29 percent of schools in correcdve acdon and 13 percent of schools in Year 1 of 
school improvement status. 
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C. Title I School Choice and Supplemental Educational Services 



How many students are eligible to participate in Title I school choice and supplemental 
educational services, and how many actually do so? 

Student eligibility for and participation in both Title I choice options continues to rise. The 

number of students eligible for Title I school choice increased from 3.3 million in 2003—04 to 5.5 million 
in 2006—07, while the number eligible for supplemental educational services increased from 1 .9 million 
to 3.6 million. Participation in the school choice option increased to 120,000 in 2006—07, up from 
65,000 in 2005—06 and 48,000 in 2004—05, while participation in supplemental services rose to 530,000 in 
2006—07, up from 498,000 in 2005—06 and 446,000 in 2004—05. The percentage of eligible students who 
participated in 2006—07 was 1 5 percent for supplemental services and 2 percent for school choice. 

Student participation rates varied widely. In districts required to offer supplemental services in 

2005— 06, 24 percent reported participation rates of more than 20 percent, while 20 percent reported 
participation rates between 5 and 20 percent, 25 percent reported at least one student participating but 
less than 5 percent, and 31 percent reported that no students participated. 

District expenditures on Title I choice options doubled from 2003—04 to 2005—06. Total spending 
on supplemental educational services was estimated at $375 million for 2005—06, up from $192 million in 
2003—04, based on district survey responses. Spending on transportation for Tide I school choice 
participants was estimated at $56 million for 2005—06, compared with $24 million in 2003—04. The 
growth in spending on these two Tide I choice opdons was roughly propordonal to the growth in 
pardcipadon over the same period. 

Districts reported spending an average of $836 per supplemental services pardcipant in 2005-06, 26 
percent less than the maximum per-child amount they reported aUocadng for such services in that year 
($1,134). 

How and when do districts inform parents of eligible children about the Title I school 
choice and supplemental services options? 

The timeliness of parental notification about the school choice option improved from 2004—05 to 

2006— 07, but still was often too late to enable parents to choose a new school before the start of 
the 2006-07 school year. Based on a nadonaUy representadve survey of districts, 43 percent of affected 
districts nodded parents about the school choice opdon before the beginning of the 2006—07 school 
year, an increase from 29 percent in 2004—05. However, 42 percent nodded parents after the school year 
had already started, and in these districts this noddcadon occurred, on average,^r« weeks after the start 
of the school year. 

Although nearly all districts required to offer school choice and supplemental services reported 
(in a nationally representative survey) that they notified parents about these options, a survey of 
eligible parents in eight large urban school districts found that many parents were unaware of 
these choice options. In these eight districts, only 20 percent of parents eligible to use the Tide I 
school choice opdon and 59 percent of those eligible to enroll their child in supplemental services said 
they had been nodded about these opdons in 2006—07. However, the eight-district sample was not 
nadonaUy representadve, so dndings based on this sample cannot be generaU 2 ed to the nadon. 
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What is the relationship between participation in Title I school choice and supplemental 
services and student achievement? 

Across a sample of seven districts, student participants in supplemental educational services 
experienced gains in achievement in both reading and mathematics that were greater than the 
gains for nonparticipating students. On average, the effect skes measured were 0.08 of a standard 
deviation unit in both reading and math for students that participated in supplemental services during 
one school year and 0.15 to 0.17 for students that received supplemental services during two or more 
years. Looking at the districts individually, positive effects were found in five of the seven districts. 

For Title I school choice, the same study did not find a statistically significant relationship 
between participation and student achievement. However, sample si 2 es for the school choice 
analysis were substantially smaller, due to the relatively small number of participants. 

It is important to note that although this study used statistical methods to control for student 
socioeconomic background, race and ethnicity, and other factors, the quasi-experimental methods used 
in this study may not fuUy control for selection bias. In other words, students who choose may be 
different from students who do not choose, and these differences may affect the results. 

How are states monitoring and evaluating the effectiveness of supplemental service 
providers? 

States have made progress in developing systems for monitoring and evaluating the 
performance of supplemental service providers. As of fall 2006, 33 states had started an evaluation 
of supplemental service providers and another 1 0 states said they anticipated starting evaluations later in 
the 2006—07 school year. Thirty-three states planned to evaluate provider effectiveness by examining 
student achievement on state assessments for participating students, up from 17 states in fall 2004, and 
12 of these states planned to use a matched control group, up from one state in fall 2004. 

The most common approaches states had implemented to monitor providers were surveying the 
districts, parents, or students about provider effectiveness (13 states), using providers’ reports of student 
enrollment or attendance (13 states), and examining test scores (10 states). However, as of fall 2006, 
eight states had not established any monitoring process. 

D. Teacher Quality and Professional Development 

How have states implemented the requirements to develop standards and procedures for 
teachers to demonstrate sufficient content knowledge to be deemed “highly qualified”? 

States vary considerably in their criteria for teachers to demonstrate content knowledge in the 
subjects they teach. For example, among the 36 states that used the Praxis II Mathematics Content 
Knowledge assessment to test new teachers’ content knowledge in mathematics, as of November 2007, 
nine states set their cut scores below the 25th percentile of all scores attained by test takers, while three 
states set the cut score above the national median. 

For veteran teachers, most states were phasing out the use of HOUSSE (High Objective 
Uniform State Standard of Evaluation) for most teachers. In early 2007, eight states indicated that 
they were discontinuing HOUSSE entirely, and another 11 states were discontinuing HOUSSE except 
for certain categories of teachers. However, 30 states reported that, while they were working to 
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discontinue HOUSSE, they had identified specific groups of teachers for whom they anticipated that 
HOUSSE would be necessary (e.g., for foreign language teachers). 

How many teachers meet the NCLB requirement to be highly qualified? 

The large majority of teachers across the country have been designated as highly qualified 
under NCLB. According to state-reported data for 50 states, 92 percent of classes were taught by 
highly qualified teachers in 2005—06. Teachers sometimes indicated that they did not know their highly 
qualified status. For example, 84 percent of teachers reported in 2006—07 that they were considered 
highly qualified under ATCLB, while 14 percent said they did not know their status and 2 percent said 
they were not highly qualified. Special education teachers were more likely to report that they were 
considered not highly qualified under NCLB than were general education teachers. 

Among teachers who said they were highly qualified under NCLB, those in high-poverty 
schools had less experience and were less likely to have a degree in the subject that they teach, 
compared with their peers in low-poverty schools. In 2006—07, 14 percent of highly qualified 
teachers in high-poverty schools had fewer than three years of teaching experience, compared with 
8 percent of highly qualified teachers in low-poverty schools. Similarly, highly qualified secondary 
mathematics teachers in high-poverty schools were less likely to have a degree in mathematics (32 
percent, compared with 50 percent in low-poverty schools). 

To what extent are teachers participating in professional development activities that are 
sustained, intensive, and focused on instruction? 

Although most teachers reported that they participated in some professional development that 
focused on instructional strategies for teaching reading or mathematics, relatively few 
participated for an extended period of time. For example, 79 percent of elementary teachers 
participated in at least one hour of professional development focused on instructional strategies for 
teaching mathematics during the 2005—06 school year and summer, but only 44 percent participated for 
six or more hours and only 1 1 percent participated for more than 24 hours. 

Teachers were less likely to report that they participated in professional development focused on 
in-depth study of reading and mathematics than in training on instructional strategies. For 

example, in 2005—06, 67 percent of elementary teachers participated in six or more hours of professional 
development focused on instructional strategies for teaching reading, but only 44 percent participated in 
six or more hours of in-depth study of topics in reading. 

Both elementary and secondary teachers reported participating in more hours of professional 
development in reading and mathematics in 2005—06 compared with 2003—04. For example, the 
percentage of elementary teachers who participated in six or more hours of professional development 
focused on instructional strategies for teaching reading rose from 59 percent in 2003—04 to 67 percent in 
2005—06, and the percentage who participated for more than 24 hours rose from 20 percent to 26 
percent. 

Teachers in schools identified for improvement were often more likely to report that they participated in 
professional development focused on reading and mathematics than were teachers in non-identified 
schools. For example, elementary teachers in identified schools were more likely than teachers in non- 
identified schools to report receiving at least six hours of professional development in instructional 
strategies for teaching reading (77 percent vs. 67 percent) and mathematics (52 percent vs. 43 percent). 
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I. Introduction 



The Title I program began in 1965 as part of the Hkmentaiy and Secondary Education Act of 1965 (ESEL4) 
and is intended to help ensure that all children have the opportunity to obtain a high-quality education 
and reach proficiency on challenging state standards. The No Child Ceft Behind Act of 2001 (NCLBJ, 
which went into effect beginning with the 2002—03 school year, strengthened the assessment and 
accountability provisions of ESEA, requiring that states set targets for school and district performance 
that would lead to the goal of all students achieving proficiency on state reading and mathematics 
assessments by the 2013—14 school year. Schools and districts that do not make adequate yearly progress 
(AYP) toward this goal for two consecutive years are identified as needing improvement and are subject 
to increasing levels of interventions designed to improve their performance and to provide students with 
additional options. NCLB also requires that all teachers of core academic subjects be highly qualified, 
which the law defines as having a bachelor’s degree and full state certification as well as demonstrating 
competency, as defined by the state, in each core academic subject that they teach. 

As part of the No Child Eeft Behind Act, Congress mandated a National Assessment of Tide I to evaluate 
the implementation and impact of the program.* The final report of the National Assessment was 
released in 2007.“ Because additional findings from Tide I evaluadon studies have become available, this 
report was prepared to provide a summary of these new findings. 

The report includes new data from the second round of data coUecdon for the two studies that are the 
main data sources for this report: the Nadonal Longitudinal Study of NCEB, which surveyed districts, 
principals, teachers, and parents, and the Study of State Implementadon of Accountability and Teacher 
Quality Under NCEB, which interviewed state Tide I directors and compiled data from state 
administradve records. Both studies collected data in 2004—05 and 2006—07. The Nadonal Assessment 
of Tide I final report summarized findings from the 2004—05 data collecdon, while this report examines 
the 2006—07 data and reports on change between the two years, and also includes an analysis of student 
achievement outcomes for Tide I school choice and supplemental educadonal services that was 
conducted in a subsample of nine large urban districts. This new report also includes updated data from 
the Nadonal Assessment of Educadonal Progress (NAEP) and consolidated state performance reports, 
including student achievement on state assessments, school and district idendficadon for improvement, 
and highly qualified teachers, and addidonal state-reported data on schools’ AYP and improvement 
status. 

The report focuses on providing the most recendy available data on Tide I implementadon and also 
examines recent trends since the enactment of the No Child Eeft Behind Act. It also provides some 
historical informadon about long-term trends in pardcipadon, funding, and student achievement. Key 
data sources for this report include the following: 

^ National Longitudinal Study of NCLB (NA!b-NCLB). This study examined the 

implementadon of NCEB provisions for accountability, teacher quality. Tide I school choice and 
supplemental educadonal services, and targedng and resource aUocadon. The study surveyed 
districts, principals, classroom teachers, special educadon teachers, and Tide I paraprofessionals 
in a nadonaUy representadve sample of 300 districts and 1,483 schools in the 2004—05 and 
2006—07 school years. The study also surveyed parents in a subsample of eight districts and 
supplemental service providers in a subsample of 16 districts, in both years. In addidon, the 
study included a quasi-experimental analysis of the reladonship between pardcipadon in Tide I 
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school choice and supplemental services and student achievement in a subsample of nine large 
urban school districts.^ 

^ Study of State Implementation of Accountability and Teacher Quality Under NCLB 
(SSI-A^CZ^. This companion study to the NLS-ATCLB collected information from aU states 
about their implementation of the accountability, assessment, and teacher quality provisions of 
the law. The study surveyed state education staff members responsible for implementing these 
provisions in 2004—05 and 2006—07. In addition, the study analy 2 ed extant data relating to state 
implementation, including state lists of schools and districts that did not make AYP and of those 
identified as in need of improvement.*'" 

^ Consolidated State Performance Reports. These annual state reports, required under NCLJi, 
provide data on student achievement on state assessments for 2005—06 and earlier years, as well 
as basic descriptive information such as numbers of schools identified for improvement. 

^ National Assessment of Educational Progress. The NAEP provides information on overall 
trends in student achievement on a consistent assessment for populations targeted by Tide I. 

The main NAEP assessments are conducted in reading and mathematics once every two years at 
grades 4 and 8. Assessments at grade 12 and in science and other subjects are also conducted 
periodically. 

For a more detailed description of these data sources, see the 2007 National Assessment of Title I Tinal Report. 

A. Technical Notes 

References in the text to differences between groups or over time that are based on sample data only 
discuss differences that are statistically significant using a significance level of 0.05. The significance 
level, or alpha level, reflects the probability that a difference between groups as large as the one 
observed could arise simply due to sampling variation, if there were no true difference between groups in 
the population. A failure to reach this level of statistical significance does not necessarily mean that two 
groups were the same or that there was no change over time; rather, a lack of statistically significant 
findings simply means that no reliable conclusion can be drawn from the analyses that were conducted. 
The tests were conducted by calculating a / value for the difference between a pair of means and 
comparing that value to a published table of critical values for /. Differences between proportions were 
tested using a chi-square statistic. Standard error tables for estimates based on sample data are included 
in Appendix C. 

Analyses of data on student achievement on state assessments, percentages of schools and districts 
identified for improvement, and reasons that schools did not make adequate yearly progress were based 
on the full population of schools as reported by each state. 

The report frequendy examines differences between high and low-poverty schools based on the 
percentage of students eligible for free or reduced-price lunches.'" In this report, survey data for “high- 
poverty schools” included schools where at least 75 percent of the students were eligible for free or 
reduced-price lunches, and “low-poverty schools” included schools where fewer than 35 percent were 
eligible for such lunches. For NAEP analyses, “high-poverty schools” included schools where 76—100 
percent of the students were eligible for free or reduced-price lunches, and “low-poverty schools” were 
defined as those with 0—25 percent eligible for subsidi 2 ed lunches.'"* 
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II. Trends in Student Achievement 



This chapter examines trends in student achievement for public school students using both state 
assessment data and the National Assessment of Educational Progress (NAEP). Student achievement 
on state assessments represents the primary criterion that the Title I statute applies to measure school 
success, but these data cannot be aggregated across states to examine national trends or used to make 
comparisons among states. Because each state has developed its own standards, assessments, and 
definitions of student proficiency, the content and rigor of these assessments are not comparable across 
states. In addition, many states have revised their assessment systems in recent years, so they often do 
not have the trend data needed to assess student progress. The NAEP provides a high-quality 
assessment that is consistent across states, but it may not be aligned with individual state content and 
achievement standards, so it may not precisely measure what students are expected to learn in their 
states. This report draws on both types of assessments to examine the most complete available 
information about the recent progress of our schools in raising student achievement. 

This report examines trends on the main NAEP assessment from the early 1990s through 2007, with a 
focus on the most recent period from 2000 to 2007, in order to show trends in NAEP results during the 
early years of ATCLB implementation. For state assessments, we examine recent trends from 2004—05 
through 2006—07) in 30 states that had consistent assessments in place over this period. The report 
focuses on presenting achievement trends for fourth- and eighth-grade reading™ and mathematics 
assessments, although some 12th-grade assessment results are examined as well. We also show trends in 
science achievement on the main NAEP. Science achievement trends are not presented for state 
assessments, because few states have consistent longitudinal data on state science assessments and 
science assessments results are not collected through the annual Consolidated State Performance Reports 
(science assessments were not required under ATCEB until 2007—08). 

It should be noted that the achievement trend data presented in this chapter do not direcdy address the 
impact of NCLB, because it is difficult to separate the effects of NCLB from the effects of other state 
and local improvement efforts. 



Key Evaluation Questions for Student Achievement 

1 . Are students whom Title I is intended to benefit (including low-income students, racial and ethnic 
minorities, LEP students, migrant students, and students with disabilities) making progress 
toward meeting state academic achievement standards in reading and mathematics? 

2. Are students, especially disadvantaged students, showing achievement gains on the National 
Assessment of Educational Progress? 

3. Are achievement gaps between disadvantaged students and other students closing over time? 
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A. Student Achievement on State Assessments 



This report examines student achievement trends for fourth-grade and eighth-grade reading and 
mathematics from 2004—05 to 2006—07 for 30 states that had consistent state standards and assessments 
in place during this period. Previous National Assessment of Title I reports found similar patterns in 
student achievement trends on state assessments for 23 states for the period from 2000—01 to 2002—03™ 
and for 36 states for the period from 2002—03 to 2004—05.“ These analyses of state assessment data 
have focused on these relatively short time periods because few states have trend data on a consistent 
state assessment available for a longer period.’^ 

While state assessments may be useful for examining change in achievement within a state, they 
may not be used to make comparisons across states. State assessments differ in the content and the 
difficulty of test items, as well as in the level that is labeled as proficient, so states with higher percentages 
of students at the proficient level are not necessarily higher performing in an absolute sense. For example, 
states that have similar proportions of students scoring at the proficient level on the NAEP may vary 
considerably in the percentage of students achieving proficiency on the state assessment (see Exhibit 1). 

In addition, caution should be used when examining change over time in the proportion of students 
performing at or above each state’s proficiency level. The data come from the Consolidated State 
Performance Reports submitted by each state and cannot speak to the reasons for observed losses or 
gains over time within each state. Observed losses or gains could reflect a number of things, including 
changes in the assessment system, population changes, or changes in the proficiency of a stable 
population. 

Exhibit 1 should not be viewed as recommending that state proficiency levels should match 
NAEP proficiency levels. NAEP achievement levels are stiU being used on a trial basis. There 
continue to be concerns about the procedures used to set the achievement levels, and the commissioner 
of the National Center for Education Statistics has not determined that they are “reasonable, valid, and 
informative to the public.” NAEP and current state assessments were established at different times to 
meet different purposes, and there is no one “right” level that should be defined as proficient. Under 
ATCLB, each state has the responsibility to establish standards and assessments and to define a proficient 
level that all students are expected to reach by 2013—14. In contrast, when the NAEP proficiency levels 
were created about 1 8 years ago, there was no expectation that all students must reach the NAEP 
proficient level by a particular date. Assessment systems vary tremendously, both between NAEP and 
state systems, as well as across states, and similar-sounding terms may not be comparable. 

In most states, eighth-grade students were less likely to reach the proficient level than were 
fourth-grade students, on both state assessments and NAEP, particularly in mathematics. On 

state assessments, eighth-graders were less likely than fourth-graders to reach their state’s proficient level 
in 2006-07 in 32 states in reading and 48 states and the District of Columbia in mathematics. On 
average, the percentage of eighth-graders performing at or above the proficient level was 3 percentage 
points lower than for fourth-grade students in reading and 8 percentage points lower in mathematics 
(based on the median difference between the two grade levels). NAEP data similarly showed a lower 
percentage of students reaching the NAEP proficient level in eighth grade than in fourth grade (see 
Exhibit 2) 
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Exhibit 1 

Percentage of Fourth-Grade Students Achieving At or Above the Proficient Levei 
on NAEP and State Assessments in Reading, 2007 




Exhibit reads: In Massachusetts, 50 percent of fourth-grade students scored at or above the proficient level 
on the state reading assessment in 2007 and 44 percent scored at or above the proficient level on the NAEP. 

Sources: Consolidated State Performance Reports; National Center for Education Statistics, Main NAEP (»=50 states and the District 
of Columbia). 
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Exhibit 2 

Proportion of Fourth- and Eighth-Grade Students Performing At or Above the Proficient Levei 
in Reading and Mathematics, on State Assessments in 2006-07 and on NAEP in 2007 

I State Assessments in 2006-07 I NAEP in 2007 



Nation 

Alabama 

Alaska 

Arizona 

Arkansas 

California 

Colorado 

Connecticut 

Delaware 

District of Columbia 

Florida 

Georgia 

Hawaii 

Idaho 



Illinois 

Indiana 



Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 



Maryland 

Massachusetts 

Michigan 

Minnesota 

Mississippi 

Missouri 

Montana 

Nebraska 

Nevada 

New Hampshire 

New Jersey 

New Mexico 



New York 

North Carolina 

North Dakota 

Ohio 

Oklahoma 



Oregon 

Pennsylvania 

Rhode Island 

South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 

Vermont 

Virginia 

Washington 

West Virginia 

Wisconsin 

Wyoming 

# of states where 
8th grade is lower 
than 4th grade 



Reading 



Mathematics 



Reading 



Mathematics 



4th Grade 8th Grade 4th Grade 8th Grade 



32 

(Median -3) 



4th Grade 
32 
29 
29 
24 
29 
23 
36 
41 
34 
14 

34 
28 
26 

35 



49 

(Median -8) 



8th Grade 
29 
21 

27 

24 

25 
21 
35 
37 

31 
12 

28 

26 
20 

32 



41 

(Median -2) 



4th Grade 

39 
26 
38 

31 
37 
30 
41 
45 

40 
14 
40 

32 

33 
40 



36 

46 



43 

51 

31 

24 

42 



40 

58 

37 

51 
21 

38 
44 
38 
30 

52 
52 
24 



43 

41 

46 

46 

33 



35 
47 
34 

36 

41 
29 
40 
39 
49 

42 
44 
33 
47 
44 



8th Grade 

31 
18 

32 
26 
24 

24 
37 
35 
31 

8 

27 

25 
21 
34 



31 

35 



35 

40 

27 

19 

34 



37 
51 

29 
43 
14 

30 

38 
35 
23 
38 
40 
17 



30 

34 
41 

35 
21 



35 

38 
28 
32 

39 
23 

35 
32 
41 
37 

36 
19 

37 
36 



50 

(Median -7) 



Sources: Consolidated State Performance Reports; National Center for Education Statistics, Main NAEP (»— 50 states and the 
District of Columbia). 
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Student achievement on state assessments, as measured by the percent of students performing at 
the proficient level, rose from 2004—05 to 2006—07 for most student groups in a majority of states 
that had consistent assessment data available for both years. For example, states showed gains in 
fourth-grade reading for low-income students in 23 out of 27 states (85 percent) (see Exhibit 3). 

Similarly, low-income students also showed gains in fourth-grade mathematics, and in eighth-grade 
reading and mathematics, in most of the states with consistent assessment data available. 



Exhibit 3 

Percentage of Low-Income Students Performing At or Above Their State’s Proficient Level 
in Fourth- and Eighth-Grade Reading and Mathematics, 2004-05 to 2006-07 




Grade 4 


Grade 8 | 




Reading 


Mathematics 


Reading 


Mathematics | 




2006-07 


Change From 
2004-05 


2006-07 


Change From 
2004-05 


2006-07 


Change From 
2004-05 


2006-07 


Change From 
2004-05 


Alabama 


78 


2 


70 


6 


61 


4 


56 


12 


Alaska 


69 


6 


65 


9 


68 


7 


46 


3 


Arizona 


51 


3 


63 


6 


47 


1 


34 


14 


Arkansas 


47 


7 


55 


16 


52 


8 


21 


3 


California 


37 


4 


46 


7 


26 


3 


59 


2 


Colorado 


75 


-1 


84 


3 


75 


1 


49 


4 


Florida 


57 


-5 


58 


5 


35 


6 


73 


17 


Georgia 






70 


5 










Illinois 










71 


14 


55 


1 


Indiana 


63 


4 


64 


4 


52 


2 


59 


1 


Iowa 


67 


1 


69 


1 


56 


1 


46 


1 


Louisiana 


62 


3 


55 


0 


49 


7 


35 


6 


Maryland 


76 


8 


76 


15 


50 


4 


43 


2 


Massachusetts 


31 


5 


27 


8 


39 


-5 


43 


-4 


Mississippi 


86 


1 


75 


3 


66 


18 


39 


5 


Montana 


70 


6 


55 


11 


43 


9 


44 


18 


New Jersey 


63 


-3 


71 


6 


50 


2 


20 


6 


New Mexico 


46 


3 


38 


7 


47 


5 






North Carolina 


79 


6 






81 


2 


53 


3 


North Dakota 


69 


5 


69 


-1 


64 


6 


49 


7 


Oklahoma 


84 


7 


75 


9 


69 


8 


68 


9 


Pennsylvania 










56 


13 


15 


4 


South Carolina 


39 


17 


39 


13 


20 


5 


56 


6 


South Dakota 


80 


3 


65 


-5 


65 


-1 


81 


2 


Tennessee 


82 


2 


84 


4 


88 


8 


63 


13 


Texas 


77 


6 


80 


6 


82 


7 


66 


6 


Utah 


67 


1 


64 


0 










Washington 


66 


-2 


42 


-2 






55 


5 


West Virginia 


76 


2 


72 


5 


72 


1 


61 


2 


Wisconsin 


68 


2 


62 


8 


70 


2 


56 


12 


Median 


68 


3 


65 


6 


56 


5 


53 


5 


# of states with 

achievement 

gains 


23 out of 27 states 


22 out of 27 states 


25 out of 27 states 


26 out of 27 states 


Exhibit reads: The proportion of low-income students performing at or above Alabama’s proficient level 
in fourth-grade reading was 78 percent in 2006—07, an increase of 2 percentage points over 2004—05. 
Overall, states that had consistent assessments during this period showed increases in the percent proficient 
on fourth-grade reading assessments in 23 out of 27 states. 

Source: Consolidated State Performance Reports (for 30 states). 
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State assessment trends for black and Hispanic students, LEP students, migrant students, and students 
with disabilities also showed similar patterns (see Exhibit 4; for state-by- state results, see Exhibits A-2 
through A- 10 in Appendix A). On average, 79 percent of the states showed achievement gains from 
2004—05 to 2006—07 for each group. 



Exhibit 4 

Percentage of States Showing an increase in the Proportion of Fourth- and Eighth-Grade Students 
Performing at or Above Their State’s Proficient Level From 2004-05 to 2006-07, by Student Group 




1 Grade 4 


1 Grade 8 | 




Reading 


Mathematics 


Reading 


Mathematics 


Low-income 


85% 


81% 


93% 


96% 


Black 


70% 


81% 


78% 


93% 


Hispanic 


74% 


81% 


81% 


85% 


White 


70% 


85% 


74% 


85% 


LEP 


74% 


89% 


67% 


63% 


Migrant 


57% 


81% 


80% 


70% 


Students with disabilities 


76% 


84% 


76% 


84% 


“All students’’ group 


74% 


78% 


74% 


89% 


Average proportion of student 
groups with achievement gains 


73% 


83% 


78% 


84% 


Exhibit reads: The proportion of low-income students performing at or above states’ proficient levels in 
fourth-grade reading increased from 2004—05 to 2006—07 in 85 percent of the states that had consistent trend 
data available. 


Note: The average proportions shown in the last row represent the number of student groups across states that showed an increase in 
the percent proficient measure divided by the total number of student groups across all states included in the analysis. 


Source: Consolidated State Performance Reports (»— 30 states: 


; f? sizes for individual cells are provided in Appendix Exhibit A-14). 



State assessment trends from 2004—05 to 2006—07 showed reductions in the achievement gaps 
between minority students and white students in fourth- and eighth-grade reading and 
mathematics. In fourth-grade reading, 1 1 out of 25 states with available data showed a reduction in the 
black-white achievement gap in the percentage of students scoring at or above their state’s proficient 
level (see Exhibit A- 10). On average, the black- white achievement gap in fourth-grade reading in these 
states declined from 23 percentage points in 2004-05 to 21 in 2006-07. Similar results were found for 
fourth-grade mathematics and eighth-grade reading and math, as well as for Hispanic-white achievement 
gaps (see Exhibits A-10 and A-11).™ 

NCLJi has established the goal of not just steady achievement growth, but also the expectation for all 
tested students to reach proficiency on state assessments in reading and mathematics by the 2013-14 
school year. To examine whether the recent growth rates for student achievement would be sufficient to 
bring all students to their state’s proficient level by 2013-14, we calculated the average annual change in 
each state’s percent proficient based on the change between 2004—05 to 2006—07, and determined the 
percent proficient that would be attained by 2013—14 if the state continued to progress at that rate. 
Exhibit 5 summarizes the number of states that would be predicted to meet the 100 percent goal for 
eight different student groups. (Exhibit A-17 shows these calculations for the low-income subgroup.) 

Based on data for 30 states, most would not meet the goal of 100 percent proficiency by 2013—14 
unless the percentage of students achieving at the proficient level increases at a faster rate. For 



























































example, among the 27 states that had consistent fourth-grade reading assessment data for low-income 
students, three states (11 percent) would meet the 100 percent goal by 2013—14 for this subgroup if they 
sustained the same rate of growth that they achieved from 2004—05 to 2006—07 (see Exhibit 5). 

Looking across eight different student categories (low-income, black, Hispanic, white, LEP, 
migrant, students with disabilities, and the “all students” group), an average of 16 percent of 
these student groups within the 30 states would reach 100 percent proficiency in fourth-grade 
reading if recent growth rates were to remain steady (see Exhibit 5). Across the four assessments 
included in this analysis (reading and mathematics in fourth grade and eighth grade), the percentage of 
student groups predicted to reach 100 percent proficiency in this analysis (16 percent, based on 
achievement trajectories from 2004—05 to 2006—07) is lower than was found in previous National 
Assessment of Tide I reports that were based on earlier state assessment trends (26 percent based on 
achievement trends from 2002—03 to 2004—05 in 36 states and 33 percent based on achievement trends 
from 2000—01 to 2002—03 in 21 states). 



Exhibit 5 

Predicted Percentage of States That Would Reach the Goal of 100 Percent Proficient by 2013-14, for 
Various Student Groups, If Achievement Trajectories From 2004-05 to 2006-07 Continue Through 2013-14 




Grade 4 


Grade 8 




Reading 


Mathematics 


Reading 


Mathematics 


Low-income 


11% 


15% 


19% 


11% 


Black 


7% 


11% 


19% 


19% 


Hispanic 


15% 


22% 


19% 


11% 


White 


19% 


30% 


19% 


11% 


Limited English proficient 


26% 


22% 


15% 


7% 


Migrant 


19% 


24% 


20% 


15% 


Students with disabilities 


16% 


12% 


24% 


12% 


“All students” group 


11% 


22% 


15% 


11% 


Average proportion of student 
groups predicted to reach 100% 


15% 


20% 


18% 


12% 


Exhibit reads: For low-income students, 1 1 percent of the states with available data would reach the 
state’s proficient level on the fourth-grade reading assessment, if their rate of change from 2004—05 to 
2006—07 were to continue through 2013—14. 


Notes: To calculate the predicted percent proficient in 2013—14, we multiplied the annualized percentage-point change from 
2002—03 to 2006—07 by the number of years remaining to 2013—14 (seven years), and added that figure to the percent proficient 
in 2006—07. It should be noted that this method assumes no variation in the rate of change. The average shown at the bottom of 
each column is based on summing the numerators and denominators reflected in the eight cells of that column, and dividing the 
total of the numerators by the total of the denominators (see Exhibit A-15). Across all four assessment t}^es in this table, 16 
percent of the subgroups were predicted to reach the 100 percent proficient goal by 2013—14. 


Source: Consolidated state performance reports (»— 30 states). 









Although a number of states were predicted to reach the 100 percent proficient target for one or more 
student group-assessment combinations, based on the assumption of a steady growth rate in their 
percent proficient, no state was predicted to reach 1 00 percent proficient for all student groups and 
assessments included in this analysis. Six of the 30 states examined would not reach the 100 percent goal 
for any of the student groups or assessments examined. 
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Most state AYP targets are not based on an expectation of steady achievement growth rates over the full 
period from 2006—07 to 2013—14. States vary in the types of growth trajectories they have used to set 
their AYP targets, and over half (28) are planning for achievement growth rates to accelerate as 2013—14 
approaches. Based on recent achievement trajectories, such acceleration will be necessary if states are to 
meet the goal of 100 percent proficient by 2013—14. 

B. Student Achievement on the National Assessment of Educational Progress 

This report examines short-term trends for public school students on the main NAEP.™ The discussion 
below examines both recent trends, in order to show trends in NAEP results during the early years of 
ATCLB implementation, as well as longer-term trends since the early 1990s.^'" Recent trends are 
examined for the period from 2002 to 2007 for reading, 2000 to 2007 for mathematics, and 2000 to 2005 
for science. 

It is important to reiterate that these NAEP achievement trends do not direcdy address the impact of 
NCUi. The timing of NAEP test administrations do not provide, in most cases, a snapshot of student 
performance just prior to ATCLB implementation, which began in the 2002—03 school year; for example, 
reading and math assessments were administered in 2000 and 2003 but not 2002, except for the fourth- 
grade reading assessment. More importandy, simple trend analyses such as these cannot separate the 
effects of NCUi from the effects of other state and local improvement efforts, demographic changes, 
and other factors that may affect student achievement trends. 

Recent NAEP trends show gains for fourth-grade public school students in reading, 
mathematics, and science, but trends for middle and high school students were mixed (see 
Exhibit 6). At the fourth-grade level, average scale scores rose in reading from 217 in 2002 to 220 in 
2007, in mathematics from 224 in 2000 to 239 in 2007, and in science from 145 in 2000 to 149 in 2005. 
At the eighth-grade level, mathematics scores also showed an increase, from 272 in 2000 to 280 in 2007, 
but the average science score was unchanged and the average reading score declined slightly, from 263 in 
2002 to 261 in 2007. At the 12th-grade level, the most recent reading and science assessments, in 2005, 
showed no change from the preceding assessments (2002 for reading and 2000 for science). Recent 
trend data for 12th-grade mathematics are not available, because the most recent NAEP 12th-grade 
mathematics assessment (for 2005) is based on a new framework and the data are not comparable with 
previous years. 

Over the complete period during which the main NAEP assessment was administered, scores increased 
significandy in mathematics and reading for fourth- and eighth-grade students and in science for fourth- 
grade students, but decreased significantly for 12th-graders in all three subjects. 
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Exhibit 6 

Main NAEP Results in Reading, Mathematics, and Science, 1990 to 2007: 
Average Scale Scores for Public School Students by School Grade Level 



Reading 



‘ 261 260* 261 



217*216* 21 7 220 

211 * 

198 2000 2002 2003 2005 2007 







Mathematics 










_ , ^ 12th Grade 




294* 


297 


303* 


300 


8th Grade 
'*280 


262^ 


^267* 


2& 


23r 


4th Grade 




* Indicates that the score is significantly different from the most 
recent score (2007 for 4th- and 8th-grade reading and 
mathematics, 2005 for science and 12th-grade reading, and 2002 
for 12th-grade mathematics) (p<.05). 

Note: The NAEP science assessment is scaled differently from the 
reading and mathematics assessments. For the first Main NAEP 
science assessment (in 1996), the mean scale score for each tested 
grade was set at 150, resulting in some overlap between the scale 
score trend lines in subsequent years (unlike the reading and math 
scales, where mean scale scores are higher for 12th and 8th grade 
than for 4th grade). For 4th grade, the average scale score in 
science rose from 145 in 1996 and 2000 to 149 in 2005. For 12th 
grade, the average scale score declined from 150 in 1996 to 145 in 
2000 and 2005. 

Source: National Center for Education Statistics, Main NAEP. 



Recent NAEP trends by race and ethnicity showed gains in fourth-grade reading, mathematics, 
and science that were larger for black and Hispanic students than for white students (see 
Exhibit 7). From 2002 to 2007, black and Hispanic students each gained five points in fourth-grade 
reading, compared with a three-point gain for white students over the same period. In fourth-grade 
math, black students gained 1 9 points from 2000 to 2007 and Hispanic students gained 20 points, again 
greater than the 15-point gain for white students. In fourth-grade science, black students gained 
seven points from 2000 to 2005 and Hispanic students gained 1 1 points, compared with a three-point 
gain for white students. 
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Over the longer term, fourth-grade mathematics scores showed even larger gains from 1990 to 2007 for 
all three racial-ethnic groups shown in this chart: black students gained 35 points, Hispanic students 
gained 28 points, and white students gained 29 points. In fourth-grade reading, the 15-year trend from 
1992 to 2007 also showed larger gains for black, Hispanic, and white students (12 points, 10 points, and 
seven points, respectively). In fourth-grade science, the nine-year gains from 1996 to 2005 were about 
the same as the gains from 2000 to 2005 (because the average scores showed litde change from 1996 to 
2000 ). 

Looking at the achievement gap between white and minority students, the recent trends in fourth-grade 
NAEP scores discussed above reflect statistically significant reductions in the black-white achievement 
gaps in reading, math, and science, as well as reductions in the Hispanic-white achievement gaps in math 
and science. For example, the black-white achievement gap in fourth-grade reading declined from 29.3 
scale score points in 2002 to 26.6 points in 2007, a reduction of 2.7 points. Black-white achievement 
gaps also declined in fourth-grade math from 2000 to 2007 (by four points) and in fourth-grade science 
from 2000 to 2005 (by four points). The Hispanic-white achievement gap for fourth-grade students 
declined in both math and science (by five points and eight points, respectively) but showed no 
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significant change in reading. Over the longer term, since the 1990s, there was a significant reduction in 
black- white achievement gaps in all three subjects, but no significant change in achievement gaps for 
Hispanic students. 

The gains for each racial or ethnic subgroup shown in Exhibit 7 tended to be larger than the average gain 
for all fourth-grade students shown in Exhibit 6. This is due in part to changes in the composition of 
the student population during this time period; white students, who had higher average achievement, 
accounted for a declining percentage of assessed students over the period examined here. In reading, for 
example, the percentage of assessed fourth-grade students who were white declined from 72 percent in 
1992 to 56 percent in 2007, while the percentage who were Hispanic rose from 7 percent to 20 percent.^'" 

At the eighth-grade level, black and Hispanic students showed recent gains in math but not in 
reading or science (see Exhibit 8). In mathematics, black students gained 12 points from 2000 to 2007 
and Hispanic students gained 16 points, compared with a seven-point gain for white students. In reading 
and science, however, there was no statistically significant change in average scale scores for any of these 
three groups over this period (since 2002 for reading and since 2000 for science). 
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Over the longer term, since the early 1990s, black and Hispanic students showed significant gains in 
reading and mathematics that were similar to the gains for white students. In reading, black and 
Hispanic students each gained six points from 1992 to 2007, compared with a five-point gain for white 
students. In mathematics, black students gained 23 points from 1990 to 2007 and Hispanic students 
gained 19 points, compared with a 21 -point gain for white students. Black students also showed a small 
increase in science scores since 1996 (a three-point gain), but science scores for Hispanic and white 
students did not change significantly. 



Recent trends in achievement gaps on the eighth-grade NAEP show reductions in the black- 
white and Hispanic-white gaps in mathematics but not in reading or science. Over the longer 
term since the 1990s, changes in eighth-grade achievement gaps for black and Hispanic 
students were not statistically significant in any of these three subjects. On the fourth-grade 
mathematics assessment, the black-white achievement gap declined from 30 points in 2000 to 26 points 
in 2007, and the Hispanic-white gap declined from 26 points to 21 points. However, there was no 
statistically significant change in eighth-grade achievement gaps in reading from 2002 to 2007 or in 
science from 2000 to 2005. We also examined achievement gaps over the full period that the Main 
NAEP has been administered (since 1992 for reading, 1990 for mathematics, and 1996 for science); 
these longer-term trends showed no significant change in black-white and Hispanic-white achievement 
gaps. 

Most states showed an increase in the percentage of students performing at or above the 
proficient level on NAEP, but the increases were smaller in reading than in mathematics. 

Looking at the “all students” group, 39 out of 51 jurisdictions (76 percent) showed an increase from 
2003 to 2007 in the percentage of students reaching the proficient level in fourth-grade reading, while 50 
out of 51 jurisdictions (98 percent) showed an increase for fourth-grade mathematics (see Exhibit 9). 
The median increase was 2 percentage points in reading and 8 percentage points in mathematics (see 
Exhibit A-21). State-by- state trends are provided in Exhibits A-21 through A-26 in Appendix A. 



Exhibit 9 

Percentage of States Showing an Increase From 2003 to 2007 in the Proportion of Fourth- and Eighth-Grade 
Students Performing At or Above the NAEP Proficient Level, by Student Group 





1 Grade 4 


1 Grade 8 




Reading 


Mathematics 


Reading 


Mathematics 


Black 


57% 


93% 


41% 


85% 


Hispanic 


56% 


93% 


46% 


81% 


White 


60% 


98% 


32% 


86% 


“All students” group 


76% 


98% 


55% 


92% 


Average proportion of student 
groups with achievement gains 


65% 


96% 


44% 


87% 



Exhibit reads: The proportion of black students performing at or above the NAEP proficient level in 
fourth-grade reading increased from 2003 to 2007 in 57 percent of the states that participated in the NAEP 
assessment in both years. 

Notes: The average proportions shown in the last row represent the number of student groups across states that showed an increase 
in the percent proficient measure divided by the total number of student groups across all states included in the analysis. 

Source: National Center for Education Statistics, Main NAEP in— HI to 51 jurisdictions, including the 50 states and the District of 
Columbia); n si 2 es for individual cells are provided in Appendix Exhibits A-21 through A-26). 
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III. Implementation of State Assessment and Accountability Systems 



The intent of NCLB is to improve achievement for all students by requiring states to establish 
assessment and accountability systems that hold aU schools, including Tide I schools and non— Tide I 
schools, to the same academic standards. Under Tide I, states must administer assessments that are 
aligned with challenging content and academic achievement standards. By 2005-06, aU states were 
expected to assess all students in grades 3—8 and once in grades 10—12 in reading and mathemadcs. By 
2007-08, states were expected to administer annual science assessments at least once in grades 3—5, 6—9, 
and 10—12. States must annually determine whether schools and districts are making adequate yearly 
progress (AYP) toward the goal of all students reaching the proficient level on state reading and 
mathemadcs assessments by 2013—1^1 — including students from low-income families and each major 
racial and ethnic group, students with disabiUdes, and limited English proficient (LEP) students. 

Schools and districts become idendfied for improvement when they miss AYP for two consecudve 
years, and states and districts are expected to provide technical assistance to help schools improve their 
performance. District also must provide each student at idendfied Tide I schools the opdon to transfer 
to a non-idendfied school in the district. If the school misses AYP again after being idendfied, the 
district must also give students from low-income families the opdon to receive supplemental educadonal 
services (e.g., tutoring) from state-approved providers. If such schools miss AYP for a second dme after 
idendficadon, districts must take at least one of a series of correcdve acdons at the school, such as 
requiring a new curriculum or replacing school staff members. If a school does not make AYP after one 
year of correcdve acdon, NCLB calls for major restructuring of the school, beginning with a year of 
planning for restructuring followed by actual restructuring the next year if the school misses AYP for a 
sixth year. Idendfied schools and districts exit improvement status when they make AYP for two 
consecudve years. 



Key Evaluation Questions for Assessment and Accountability Systems 

1. To what extent have states implemented the annual assessments in reading, mathematics, science, 
and English language proficiency that are required under NCLB? 

2. How many schools and districts have been identified for improvement under NCLB and what are 
their characteristics? 

3. What are the reasons schools do not make adequate yearly progress (AYP)? 

4. What assistance is provided to districts and schools identified for improvement? What 
interventions are implemented in these districts and schools? 



A. Development of Assessments Required Under JVo Child Left Behind 

During the 2006—07 school year, all states administered assessments intended to meet NCLB 
requirements for reading and mathematics. As of Jan. 8, 2009, 39 state assessment systems had 
been approved by the Department, through a peer review process, as meeting all A^CZ,.6 testing 
requirements for reading and mathematics (see Exhibit 10).™ For the remaining states, the evidence 
submitted indicated that one or more fundamental components were missing or did not meet the 
statutory and regulatory requirements, and reviews of their state assessment systems are continuing.™* 
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Exhibit 10 

NCLB State Assessment Approval Status, as of Jan. 8, 2009 




Number of States 


States 


Full Approval 


39 


Alabama, Alaska, Arizona, Arkansas, Colorado, Connecticut, 
Delaware, Florida, Georgia, Idaho, Illinois, Indiana, Iowa, Kansas, 
Kentucky, Louisiana, Maine, Maryland, Massachusetts, Michigan, 
Minnesota, Missouri, Montana, New Mexico, New York, North 
Carolina, North Dakota, Ohio, Oklahoma, Pennsylvania, Rhode Island, 
South Carolina, South Dakota, Tennessee, Utah, Virginia, 

Washington, West Virginia, Wisconsin 


Approval Pending 


13 


California, District of Columbia, Flawaii, Mississippi, Nebraska, 
Nevada, New Flampshire, New Jersey, Oregon, Puerto Rico, Texas, 
Vermont, Wyoming 


Exhibit reads: Thirty-nine states have received Department approval indicating that their reading and 
mathematics assessments met all statutory and regulatory requirements under NCUi. 


Source: U.S. Department of Education, Office of Elementary and Secondary Education (»=50 states, the District of Columbia, and 
Puerto Rico). 



Further peer reviews will be done as evidence becomes available. Some of the “approval pending” states 
will enter into compliance agreements with the Department because the evidence indicated that it will 
take more than a year for the state to meet the assessment requirements, and the state has submitted a 
detailed plan of action for coming into compliance. Challenges states commonly faced in implementing 
assessment systems that are fuUy compliant included the development of alternate assessments for 
students with the most significant cognitive disabilities, aligning assessments to state academic content 
standards, and documenting the technical quality of their assessment systems. 

Although NCLB did not require science assessments to be in place until 2007—08, seven states had 
science assessments approved prior to May 2008, along with their reading and mathematics assessments. 
As of December 2008, a total of 1 1 states have approved science assessments.™ 

As of 2005—06, most states were meeting the requirement to annually assess at least 95 percent of 
all students, including students from all major racial and ethnic groups, students with disabilities, limited 
English proficient students, and students from low-income families. However, 1 6 states did not meet the 
minimum test participation requirement for one or more student subgroups. Seven states assessed fewer 
than 95 percent of one or more minority student groups (black, Hispanic, or Native American), eight 
states did not meet the test participation requirement for students with disabilities, and 1 1 states did not 
meet the test participation requirement for LEP students. The number of states falling short of the 95 
percent participation requirement in 2005—06 was about the same as in 2004—05 (16 vs. 15). 

AH states have implemented alternate assessments based on alternate achievement standards for 
students with the most significant cognitive disabilities. The 39 state assessment systems approved 
by the Department as of Jan. 8, 2009 include such alternate assessments. For about half of all states, 
reasons their assessment systems have not yet been approved included major issues related to their 
implementation of alternate assessments based on alternate achievement standards.™ 

Nearly aU states had implemented English language proficiency (ELP) assessments as of the 
2006—07 school year. Although many states had some type of proficiency test for limited English 
proficient (LEP) students prior to NCLH, these tests were generally designed for placement purposes 
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rather than to measure progress in acquiring language proficiency. Most states have implemented new 
ELP assessments in recent years; 46 states implemented their current ELP assessment during or after 
2004—05. As of 2006—07, all but one state had an ELP assessment in place, and the remaining state 
planned to implement its ELP assessment in 2007—08. State directors anticipated making only small 
revisions to update or align their ELP assessments. Almost half (23) of the states developed their ELP 
assessment in collaboration with multi-state consortia. Other approaches were adopting an ELP 
assessment from an out-of-state source (five states), adapting an assessment from an out-of-state source 
(nine states), and developing an assessment specifically for or by the state (13 states).^ 

B. School and District Identification for Improvement 

States identified a total 
of 13,103 schools for 
improvement, or 15 
percent of the nation’s 
schools, in 2006—07 (based 
on test scores for 2005-06 
and earlier years). Tide I 
schools accounted for 82 
percent of all identified 
schools, and the 10,781 
identified Tide I schools 
represented 20 percent of all 
Tide I schools.™* 

The 10,781 Tide I schools 
idendfied for improvement 
in 2006-07 represented 
about 1 ,000 more than the 
number in 2005—06 (9,694), 
an 1 1 percent increase, 
following a smaller increase 
the previous year (see 
Exhibit 11). Overall, 9.0 
million students attended 
schools idendfied for 
improvement in 2006—07, up 
from 7.3 million in 2004—05. 

There was considerable 
change in which schools 
were idendfied: 31 percent of 
the Tide I idendfied schools 
in 2006—07 had not been 
idendfied the previous year, 

and 12 percent of Tide I idendfied schools in 2005—06 were no longer idendfied in 2006—07.**™ 



Exhibit 11 

Number and Percentage of Titie i Schoois That Were 
identified for improvement, 1996-97 to 2006-07 




97 98 99 00 01 02 03 04 05 06 07 



Exhibit reads: In 2006—07, 10,781 Tide I schools had been identified for 
improvement based on test scores for 2005—06 and earlier years; identified 
schools represented 20 percent of all Tide I schools in that year. 

Notes: The first year that schools were identified for improvement based in part on 
NCUi AYP definitions was 2003-04, based on assessments administered in 2002-03. 
However, schools are idendfied when they miss AYP for two consecutive years, and 
2004—05 was the first year that included schools identified because they missed NCLB 
AYP targets for two consecutive years. Data for 2002-03 are not available due to a 
change in reporting requirements that was implemented beginning with the 2002—03 
Consolidated State Performance Report.™ 

Source: Consolidated State Performance Reports (based on data reported by 50 states, the 
District of Columbia, and Puerto Rico).™* 
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Almost half of Title I schools 
identified for improvement 
were in the more advanced 
stages of identification status. 

Forty-six percent of aU identified 
Tide I schools in 2006—07 were in 
either corrective action or 
restructuring, up from 33 percent 
in 2005—06 and 23 percent in 

2004— 05. The number of Title I 
schools in corrective action, more 
than doubled from 1,223 in 

2005— 06 to 2,663 in 2006-07 
(25 percent of identified Title I 
schools), while the number in 
restructuring status rose from 
1,683 to 2,270 (21 percent of 
identified Title I schools) (see 
Exhibit 12). 

The number and percentage of 
schools identified for 
improvement varied 
considerably across states (see 
Exhibit 13). States differ in not 
only their si 2 e and total number of schools, but also in the content and rigor of their assessments and 
academic achievement standards as well as other features of their accountability systems. As a result, 
variation across states in the numbers and percentages of identified schools likely reflects differences in 
state accountability systems as well as differences in student achievement; states with more identified 
schools are not necessarily lower performing than states with fewer identified schools. StiU, nine states 
had identified only 5 percent or fewer of their Title I schools, while 12 states had identified more than 
one-third of their Title I schools in 2006—07. Similarly, the numbers of Title I schools in corrective 
action or restructuring status varied by state, from fewer than five in several states to more than 200 in a 
few states.=‘=‘'" 

Non— Title I schools accounted for 18 percent of aU schools that were identified for improvement 
in 2006—07. In eleven states, non— Title I schools accounted for more than half of the identified schools 
in those states. Twenty-four states reported that they identified non— Title I schools for improvement in 

2006— 07 (reporting a total of 2,322 non— Title I identified schools). Fewer states had assigned non— Title I 
schools to corrective action status (18) or restructuring status (16). Overall, states had placed about 550 
non— Title I schools in corrective action or restructuring. Few states required the NCIJi consequences of 
public school choice and supplemental educational services in non— Title I schools that were identified 
for improvement (three states) 



Exhibit 12 

Number of Identified Title I Schools by Identification Status, 
2004-05 to 2006-07 



8,000 n 




Year 1 or Year 2 Corrective Action Restructuring 



Exhibit reads: The number of Title I schools in the first or second 
year of school improvement status declined from 7,157 in 2004—05 
to 5,848 in 2006-07. 

Source: Consolidated State Performance Reports (based on data reported by 50 
states, the District of Columbia, and Puerto Rico). 
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Exhibit 13 

Number and Percentage of Schools Identified for Improvement, by State, 2006-07 





All Schools 
(Title 1 and Non-Title 1) 


Title 1 Schools 


Title 1 Schools by Improvement Status 






Percent 




Percent 






Corrective 

Action 


1 Restructuring 




Number 


of All 
Schools 


Number 


of Title 1 
Schools 


Yean 


Year 2 


Plan 


Implement 



Total 


13,103 


Alabama 


459 


Alaska 


229 


Arizona 


161 


Arkansas 


209 


California 


2,240 


Colorado 


112 


Connecticut 


162 


Delaware 


34 


District of Columbia 


103 


Florida 


1,004 


Georgia 


380 


Hawaii 


174 


Idaho 


282 


Illinois 


581 


Indiana 


157 


Iowa 


18 


Kansas 


25 


Kentucky 


158 



15% 




34% 


289 


46% 


113 


9% 


161 


18% 


209 


23% 


2,240 


7% 


112 


17% 


110 


18% 


7 


53% 


103 


31% 


1,004 


19% 


175 


61% 


143 


45% 


98 


16% 


575 


8% 


157 


1% 


11 


2% 


25 


13% 


158 



20 % 

33% 

41% 

14 % 

25% 

37% 

17 % 

23% 

7% 

53% 

72% 

15% 

71% 

26% 

24% 

20 % 

2% 

4% 

19 % 





2,321 


209 


54 


12 


24 


75 


24 


69 


63 


719 


339 


36 


25 


23 


17 


2 


1 


17 


53 


128 


302 


51 


34 


38 


14 


77 


9 


82 


85 


99 


25 


4 


3 


12 


8 


69 


27 



2,663 

3 

35 

36 

54 

482 

21 _ 

63 

3 

33 

544 

23 

38 

1_2 

^ 

18 

4 

3 

56 



999 

5 

30 

12 

19 

343 

16 

1 _ 

0 

0 

30 

19 

3 

0 

177 

6 

0 

2 

1 



18 

12 

14 

4 

357 

14 

6 

1 _ 

0 

0 

48 

50 

0 

138 

9 

0 

0 

5 



Louisiana 87 7% 72 8% 32 33 3 4 0 



Maine 


166 


32% 


20 


5% 


9 


3 


4 


0 


0 


Maryland 


181 


13% 


96 


25% 


20 


13 


15 


2 


46 


Massachusetts 


613 


35% 


455 


45% 


203 


73 


129 


24 


26 


Michigan 


403 


14% 


154 


8% 


21 


34 


46 


16 


37 


Minnesota 


63 


5% 


63 


7% 


23 


27 


10 


3 


0 


Mississippi 


57 


7% 


57 


9% 


23 


21 


12 


0 


1 


Missouri 


105 


5% 


105 


10% 


24 


64 


17 


0 


0 


Montana 


52 


11% 


52 


8% 


5 


11 


4 


1 


31 


Nebraska 


1 


<1% 


1 


<1% 


0 


0 


0 


1 


0 


Nevada 


70 


12% 


70 


52% 


25 


18 


18 


9 


0 


New Hampshire 


88 


19% 


34 


14% 


17 


15 


2 


0 


0 


New Jersey 


424 


19% 


424 


34% 


147 


112 


100 


16 


49 


New Mexico 


346 


43% 


262 


45% 


106 


62 


29 


17 


48 


New York 


513 


12% 


513 


17% 


110 


93 


67 


77 


166 


North Carolina 


299 


13% 


299 


26% 


160 


65 


59 


10 


2 


North Dakota 


19 


5% 


19 


6% 


0 


0 


3 


2 


14 


Ohio 


704 


18% 


472 


22% 


252 


92 


76 


19 


33 


Oklahoma 


37 


2% 


37 


3% 


10 


12 


10 


3 


2 


Oregon 


44 


3% 


44 


7% 


20 


14 


9 


0 


1 


Pennsylvania 


455 


15% 


176 


10% 


45 


24 


29 


15 


63 


Puerto Rico 


837 


53% 


799 


100% 


184 


207 


316 


62 


30 


Rhode Island 


61 


20% 


24 


17% 


1 


10 


9 


2 


2 


South Carolina 


187 


17% 


187 


37% 


53 


28 


69 


27 


10 


South Dakota 


45 


6% 


45 


13% 


10 


14 


7 


12 


2 


Tennessee 


171 


11% 


70 


8% 


17 


23 


10 


1 


19 


Texas 


291 


4% 


291 


5% 


186 


70 


33 


2 


0 


Utah 


10 


1% 


10 


4% 


5 


4 


0 


0 


1 


Vermont 


23 


7% 


15 


7% 


1 


2 


2 


0 


0 


Virginia 


62 


4% 


62 


8% 


17 


29 


12 


2 


2 


Washington 


100 


5% 


100 


11% 


47 


15 


26 


4 


8 


West Virginia 


23 


3% 


23 


6% 


7 


9 


6 


0 


1 


Wisconsin 


50 


2% 


33 


3% 


15 


6 


7 


4 


1 


Wyoming 


28 


8% 


7 


4% 


3 


1 


3 


0 


0 



Source: Consolidated State Performance Reports and Study of State Implementation of Accountability and Teacher Quality 
Under AlCLB (based on data reported by 50 states, the District of Columbia, and Puerto Rico). 
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Most schools identified for 
improvement were 
concentrated in a relatively 
small number of districts (see 
Exhibit 14). In 2006—07, only 
2,618 districts (19 percent of aU 
Title I districts) had one or 
more Tide I schools identified 
for improvement in 2006—07, 
and 71 percent of these (1,871 
districts) had only one or two 
such schools. Nearly half 
(47 percent) of all Title I 
identified schools were located 
in 122 districts that had 13 or 
more schools identified for 
improvement, and 19 percent 
were located in the 1 5 school 
districts that had the largest 
numbers of identified schools. 

Schools in restructuring status 
were particularly likely to be 
concentrated in a small set of 
districts; the 1 5 districts with 
the most Title I schools in 
restructuring status accounted 
for 37 percent of all Title I 
schools in restmcturing status.’^™' 

Middle schools were more likely to be identified for improvement than were elementary schools 
or high schools. Twenty-two percent of middle schools were identified schools in 2006—07, compared 
with 14 percent of high schools and 13 percent of elementary schools. However, because elementary 
schools account for a majority of aU schools, they accounted for a larger total number of identified 
schools (6,701) compared with middle schools (3,573) and high schools (2,363).’^™“ 

Schools with high concentrations of poor and minority students were much more likely to be 
identified for improvement than were other schools. Over one-third of high-poverty schools (38 
percent) and schools with high concentrations of minority students (38 percent) were identified schools 
in 2006—07, compared with 4 to 5 percent of schools with low concentrations of these students. Schools 
in urban areas were more likely to be identified (25 percent) than were suburban and rural schools (12 
percent and 9 percent, respectively). Schools with high concentrations of LEP students and schools in 
large districts also were identified at higher rates than other schools. 

Minority students and students from low-income families were more likely to attend schools identified 
for improvement than were other students. For example, 29 percent of African-American students, 32 
percent of Hispanic students, and 22 percent of Native American students attended schools identified 
for improvement in 2006—07, compared with 9 percent of white students. Similarly, 26 percent of 
students from low-income families attended schools identified for improvement, compared with 1 8 
percent of aU students. 



Exhibit 14 

Distribution of Titie I Districts and Distribution of Titie I Schoois identified 
for Improvement, by Number of Identified Schoois in the District, 2006—07 




Identified for 
Improvement 



Exhibit reads: Districts with 13 or more Tide I schools identified 
for improvement accounted for 1 percent of all Titie I districts and 
47 percent of all identified Title I schools. 

Source: Study of State Implementation of Accountability and Teacher Quality Under 
ATCUB (based on data reported by 50 states, the District of Columbia, and Puerto Rico). 
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Most schools that were identified for improvement for 2004—05 remained in improvement status two 
years later (in 2006—07), and most of these schools had progressed to more advanced stages of 
improvement status. Nearly three-fourths (72 percent) of the schools identified for 2004—05 continued 
to be identified schools in 2006—07, while 28 percent had exited school improvement status (see Exhibit 
15). About half of the 2004—05 cohort of identified schools had moved into either corrective action (25 
percent) or restructuring status (22 percent) by 2006—07; the remaining schools were designated as in 
Year 1 or Year 2 of school improvement status (8 percent and 17 percent, respectively). Two-thirds (66 
percent) of the schools in corrective action in 2004—05 had moved into restructuring status by 2006—07. 
Over three-fourths (78 percent) of the schools in restructuring status in 2004—05 were stiU in 
restructuring status in 2006—07. Nearly aU (93 percent) of the schools that were not identified for 
improvement in 2004—05 continued to be non-identified schools in 2006—07. 



Exhibit 15 

Percentage of Schools Identified for Improvement in 2004-05 That Were in 
Various Stages of School Improvement Status in 2006-07 






1 School Improvement Status in 2006-07 | 


School Improvement 
Status in 2004-05 


n 


No Longer 
Identified for 
Improvement 


Year 1 of 
Improvement 
Status 


Year 2 of 
Improvement 
Status 


Corrective 

Action 


Restructuring 
(Year 1 ) 


Restructuring 
(Year 2) 


All Schools Identified 
for Improvement 


9,767 


28% 


8% 


17% 


25% 


10% 


12% 


Year f of School 
Improvement Status 


5,895 


29% 


12% 


25% 


34% 


1% 


1% 


Year 2 of School 
Improvement Status 


1,454 


23% 


2% 


10% 


23% 


42% 


0% 


Corrective Action 


911 


20% 


2% 


2% 


11% 


23% 


43% 


Restructuring 


1,069 


19% 


1% 


1% 


0% 


7% 


71% 


Exhibit reads: Of the schools that were identified for improvement for 2004—05, 28 percent were no 
longer identified for improvement in 2006—07. 


Source: Study of State Implementation of Accountability and Teacher Quality Under NCLB (based < 
states, the District of Columbia, and Puerto Rico). 


on data reported by the 50 



Although only 13 percent of districts were identified for improvement in 2006—07, these districts 
accounted for 40 percent of the nation’s students. A total of 1,728 districts in 47 states were 
identified for improvement in 2006—07. Among the identified districts, 381 districts in 26 states were 
identified for corrective action, a six-fold increase over 2005—06. One-fourth (25 percent) of identified 
districts in 2006—07 (431 districts) contained no schools identified for improvement.^’^ 

C. Adequate Yearly Progress Ratings for Schools and Districts 

Nearly three-quarters of aU schools (73 percent) and districts (71 percent) met all applicable 
AYP targets in 2005—06 testing. Of those schools that missed AYP, 63 percent missed reading 
achievement targets, 56 percent missed mathematics targets, and 42 percent missed achievement targets 
in both reading and mathematics. Ten percent made AYP for both reading and mathematics 
achievement but missed AYP for another indicator, i.e., test participation rate or the “other academic 
indicator,” which for high schools is graduation rate and for other schools is usually attendance rate. 
High schools and middle schools were more likely to miss AYP in 2005—06 (34 percent and 41 percent, 
respectively) than were elementary schools (19 percent). Forty percent of high schools missed AYP for 
graduation rate (40 percent), while 14 percent of elementary schools missed AYP for their other 
academic indicator. 
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The percentage of schools that missed AYP varied greatly among states, ranging from 5 to 86 
percent of schools in a state. The number of schools missing AYP (24,049) based on 2005—06 testing 
was nearly double the number of schools identified for improvement for 2006—07 (13,1 OS).™* 



Exhibit 16 

AYP Targets Missed by Schoois That Did Not Make 
Adequate Yearly Progress, 2003-04 to 2005-06 



1 00% H 



80% 1 



60% 



40% i 



20 % 



0% -I- 




2003-04 



2004-05 



2005-06 



Schools most commonly 
missed AYP for the 
achievement of all 
students or for a 
combination of AYP 
targets. Based on data 
from 43 states, among 
schools that missed AYP in 
2005—06, 35 percent did not 
meet achievement targets 
for the “aU students” group 
in reading, mathematics, or 
both (see Exhibit 16). An 
additional 20 percent of 
these schools missed AYP 
for the achievement of two 
or more subgroups although 
they made AYP for the aU 
students group. About one- 
fourth (24 percent) missed 
AYP solely due to the 
achievement of a single 
subgroup, most commonly 
students with disabilities 
(14 percent); smaller 
percentages of schools 
missed AYP solely due to 
the achievement of LEP 
students (4 percent), low- 
income students (4 percent), 
or a single racial or ethnic 
subgroup (3 percent). 

Similarly, few schools missed AYP solely due to the “other academic indicator” (6 percent) or low test 
participation rates (4 percent). The patterns were relatively consistent across the three years for which 
these data are available (2003—04 to 2005—06). A different number of states and schools were included 
in the analyses for different years, but the patterns are also consistent when the analysis is restricted to 
include only the 26 states with data available for all three years (see Exhibit A-28 in Appendix A).’=™ 



Exhibit reads: In 2003—04 testing, 33 percent of schools that 
missed AYP missed for the achievement of the “all students” 
group in reading, mathematics, or both. 

Notes: Schools included in the “Achievement of ‘All Students’ Group” and the 
"Achievement of Two or More Subgroups" segments of the graph may have also missed 
AYP for test participation or the other academic indicator. However, schools included 
in the "Achievement of a Single Subgroup Only" segment are those that missed AYP 
for that factor alone and did not miss any other AYP targets. 

Source: Study of State Implementation of Accountability and Teacher Quality 
Under NCLB (based on data reported by 33 states for 15,731 schools that missed 
AYP in 2003-04, by 39 states for 19,474 schools in 2004—05, and by 43 states for 
20,463 schools in 2005-06). 



Schools in corrective action or restructuring status were more likely than other schools to miss 
AYP for the “aU students” group or for the achievement of two or more subgroups. In 2006—07, 
56 percent of corrective action schools and 63 percent of schools in restructuring status had missed AYP 
for the “all students” group (based on 2005—06 assessments), compared with 37 percent of schools that 
had been identified for improvement for the first time and 26 percent of schools that had missed AYP 
but were not identified for improvement. Conversely, 1 3 percent of schools in corrective action and 
restructuring status had missed AYP for the achievement of a single subgroup, compared with 28 
percent of non-identified schools that had missed AYP for this reason (see Exhibit 17). 
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Exhibit 17 

AYP Targets Missed by Schoois That Did Not Make AYP in 2005—06, 
by Stage of Schooi Improvement Status for 2006-07 



100% n 
80% - 



60% ^ 



40% ^ 



20 % - 
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Not Identified Yearl Year 2 Corrective Restructuring 

Action 



Exhibit reads: In 2006—07, among schools that were not identified for improvement and did not make 
adequate yearly progress, 26 percent missed AYP for the achievement of the “all students” group. 

Source: Study of State Implementation of Accountability and Teacher Quality Under NCLB (»=89,474 schools, based on data 
reported by 50 states, the District of Columbia, and Puerto Rico). 



A large majority of students from most racial and ethnic groups attended schools held 
accountable for the performance of their subgroups. NCLB permits states to establish minimum n 
si 2 es for the number of students in a particular subgroup that must be present in the school to include 
the subgroup in the school’s AYP calculations. These n si 2 es range from a low of 1 in North Dakota to 
a high of 50 in California, Texas, Virginia, and West Virginia; most states used a minimum n size of 30 to 
40 students. Across 41 states with available data for the 2005—06 testing year, looking at students in 
grades that are to be tested under the NCLB requirements, 97 percent of white students were in schools 
in which AYP was calculated for their subgroup, as were 85 percent of African-American students and 
83 percent of Hispanic students. However, only about half of Asian and Native American students were 
in schools in which AYP was calculated for these subgroups (55 percent and 47 percent, respectively). 
Nationally, an estimated 2.6 million students had their racial or ethnic subgroup excluded from AYP 
subgroup calculations at the school level, based on the current state minimum n si 2 es, although they were 
included in AYP calculations for the school as a whole and in AYP subgroup calculations at the district 
level when minimum n si 2 es were met at those levels. In contrast, an estimated 22.5 million students (90 
percent of students in tested grades) were included in school-level racial and ethnic subgroup 
calculations. 

In schools in which AYP was calculated for students with disabilities, LEP students, or African- 
American students, more than one-quarter did not make AYP for those subgroups in 2005—06 testing. 
For example, in schools for which AYP was calculated for students with disabilities, 43 percent of these 
schools missed AYP for that subgroup. Schools with LEP and African-American subgroups missed 
AYP for those subgroups in 30 and 25 percent of the cases, respectively. Schools with subgroups of 
students from low-income families and Hispanic students were somewhat less likely to miss AYP for 
those subgroups (18 to 20 percent). Schools were less likely to miss AYP due to low achievement of 
white students (3 percent), Asian students (2 percent), or Native American students (8 percent) 
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Schools that were held 
accountable for more 
subgroups were less likely 
to make AYP. Among 
schools for which AYP was 
calculated for six or more 
subgroups in 2005—06, 43 
percent did not make AYP, 
compared with 7 percent of 
schools for which AYP was 
calculated based on only one 
subgroup (see Exhibit 

18) .XXXV 

Looking at individual 
student subgroups, each 
subgroup was more likely to 
miss making AYP when it 
was in a school with a higher 
poverty level or a higher 
concentration of minority 
students. For example, the 
African-American subgroup 
missed AYP in 2005—06 in 
1 1 percent of low-poverty 
schools but 34 percent of 

high-poverty schools (see Exhibit 19). Similarly, the students with disabilities subgroup missed AYP in 
32 percent of low-poverty schools but 61 percent of high-poverty schools. Each student subgroup was 
also more likely to miss AYP if it was in a minority-isolated school (see Exhibit A-29 in Appendix A). 



Exhibit 18 

Percentage of Schoois That Missed AYP, 
by Number of Subgroups in the Schooi, 2005-06 




■ 1 subgroup 

□ 2 subgroups 

□ 3 subgroups 

□ 4 subgroups 

■ 5 subgroups 

□ 6-8 subgroups 



100 % 



Exhibit reads: In 2005—06, among schools for which AYP was 
calculated for only one subgroup, only 7 percent missed AYP, while 
56 percent of schools that were held accountable for the achievement of 
six or seven subgroups missed AYP. 

Source: Study of State Implementation of Accountability and Teacher Quality Under 
NCUi (»=69,966 schools, based on data reported by 46 states). 



Exhibit 19 

Percentage of Schools That Missed AYP for Individual Student Subgroups, 
By School Poverty Rate, 2005-06 






Less Than 


35-50% 


50-75% 


75% or More 






35% Poverty 


Poverty 


Poverty 


Poverty 


African-American 


11% 


22% 


31% 


34% 


Asian 


2% 


8% 


17% 


25% 


Hispanic 


8% 


17% 


23% 


32% 


Native American 


7% 


14% 


23% 


43% 


White 


1% 


2% 


5% 


12% 


Low-income students 


12% 


17% 


22% 


31% 


Students with disabilities 


32% 


45% 


50% 


61% 


LEP students 


13% 


26% 


38% 


49% 


Exhibit reads: In 2005- 


-06, among low-poverty schools for which AYP was 


calculated for African-American students, 1 1 percent missed AYP for that subgroup. 


Source: Study of State Implementation of Accountability and Teacher Quality Under NCUi (»=81,836 


1 schools, based on data reported by 47 states). 
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D. Communication of School Performance Results 



Over half of all states (27) notified schools of the final determinations on their school 
improvement status for 2006—07 (based on 2005—06 testing) before September 2006. Forty-four 
states, the District of Columbia, and Puerto Rico provided preliminary results by that time, a 42 percent 
increase from fall 2004. Twelve states did not notify schools of their final designation for 2006—07 until 
November 2006 or later — roughly half the number as in previous years — and only one state did not 
release preliminary data until November 2006 or later (see Exhibit 20).^™ In short, the timing of 
notification about school improvement status has improved over previous years, but some states 
continue to provide this notification well after the start of the school year. 



Exhibit 20 

Timing of State Notification About School Improvement Status, Fall 2004 and Fall 2006 



Preliminary Notification 



Final Notification 




Number of States 



Number of States 



Exhibit reads: In 2006, 44 states, the District of Columbia, and Puerto Rico reported releasing 
preliminary data on whether schools were identified for improvement before September, up from 31 
states in 2004. 



Source: Study of State Implementation of Accountability and Teacher Quality Under NCLB (n for 2004 — 50 states and the 
District of Columbia; » for 2006 = 50 states, the District of Columbia, and Puerto Rico). 



Principals and teachers were not always aware that their school had been identified as in need of 
improvement, although principal awareness has improved. In Tide I schools that had been 
identified for improvement for 2006—07, 13 percent of principals incorrectly reported that their school 
had not been identified for improvement, an improvement from 22 percent in 2004—05 and 41 percent 
in 2001—02. Among teachers in identified Title I schools, 28 percent of elementary teachers and 36 
percent of secondary teachers were not aware that their school had been identified for improvement for 
2006—07, similar to the percentages for 2004—05 (30 percent and 37 percent, respectively) 

Parents in a sample of eight urban school districts frequently did not know whether their child’s 
school had been identified as low-performing. A survey of parents conducted in the eight districts 
during the 2006—07 school year explained that a federal law called the No Child l^eft Behind Net 
states to name the schools that are low-performing each year, and asked if the parent knew whether their 
child’s school was on the state’s list of low-performing schools. Less than one-fifth (19 percent) of the 
parents of students in identified schools correctly said the school was on the state’s list of low- 
performing schools; 13 percent said their school was not on the list of low-performing schools, but most 



25 







(68 percent) said they were not sure. Parents in non-identified schools were more likely to accurately 
report that their school was not on a list of low-performing schools (43 percent), but a substantial 
minority (35 percent) was not sure.™™ 

However, parents of students in identified schools were significantly less likely than other 
parents to express satisfaction with their child’s school. In the same survey in eight districts, only 
59 percent of parents in identified schools said they would give their child’s school an A or B, compared 
with 83 percent of parents in non-identified schools, and 9 percent said they would give the school a D 
or F, compared with 4 percent of parents in non-identified schools. Parents also gave identified schools 
lower ratings on a number of specific factors such as educational quality, their child’s current teacher, 
school safety, and discipline.™*^ 

E. School Improvement Efforts and Assistance for 
Identified Schools and Districts 

In 2006—07, all states had established systems of support for school improvement as required by NCLB. 
Most reported providing some level of support to all identified schools, while others targeted support to 
a subset of identified schools. The most common support mechanisms used by states were two of those 
mandated by NCLB: school support teams and distinguished teachers or principals. Fifteen states 
reported that support teams were the primary form of support, while in 14 other states, school 
improvement specialists took on this responsibility. In five states, support for identified schools was 
relatively limited, consisting of statewide meetings or simply the provision of information about available 
resources and grants.*** 

Identified schools were much more likely to report needing and receiving assistance in a variety 
of specific areas compared with non-identified schools. For example, in 2006—07, 77 percent of 
identified schools reported needing technical assistance to improve the quality of professional 
development, compared with 53 percent of non-identified schools. Similarly, 72 percent of identified 
schools reported needing assistance to get parents more engaged in their child’s education, compared 
with 46 percent of non-identified schools. Although many districts with identified schools provided a 
variety of assistance to both identified and non-identified schools, schools identified for improvement 
tended to report a higher intensity of support than other schools. For the 2005—06 school year, 
identified schools reported receiving about eight days of technical assistance, on average, compared with 
four days for non-identified schools. Forty-two percent of identified schools reported receiving six or 
more days of technical assistance, 27 percent received at least 1 1 days of assistance, and 1 1 percent said 
they received more than 25 days of assistance.**** 

The most common improvement strategies reported by identified schools as a “major focus” 
were using achievement data to inform instruction (88 percent) and providing additional 
instruction to low-achieving students (77 percent). Other common strategies included aligning 
curricula and instruction with standards and assessments (81 percent), new instmctional approaches or 
curricula in reading and mathematics (66 percent and 64 percent, respectively), and increasing the 
intensity, focus, and effectiveness of professional development (63 percent). Eighty-three percent of 
identified schools also reported developing a school improvement plan. Though many non-identified 
schools reported similar school improvement strategies, they were less likely to report a major focus on 
any one of these activities.***** 

Most elementary teachers reported no change from 2004—05 to 2006—07 in the amount of 
instructional time that they spent on various subjects, based on a survey administered by the 
National Longitudinal Study of JSICLB. About one-fifth of the teachers reported increasing the 
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amount of time they spent on reading (22 percent) and mathematics (18 percent); few reported a 
decrease in time spent on these two subjects (3 to 4 percent) (see Exhibit 21). Twelve percent reported 
decreasing the amount of instructional time for science and social studies instruction, while 5 to 6 
percent reported an increase; 82 to 83 percent reported no change in instructional time for these two 
subjects. Ninety percent of elementary teachers reported no change in time spent on art and music, 6 
percent reported a decrease, and 4 percent reported an increase. Principal reports on this issue yielded 
similar findings (see Exhibit A-30 in Appendix A). Differences by school improvement status, poverty 
rate, and other school characteristics were in most cases not statistically significant.’^**' 





Exhibit 21 






Percentage of Elementary Teachers Who Reported Changing the Amount of 
Instructional Time That They Spent on Various Subjects From 2004-05 to 2006-07 




Increase in Time 


No Change 


Decrease in Time 


Reading/English/language arts 


22% 


76% 


3% 


Mathematics 


18% 


78% 


4% 


Science 


6% 


82% 


12% 


Sociai studies/history 


5% 


83% 


12% 


Art/music 


4% 


90% 


6% 


Physicai education/health 


5% 


89% 


6% 


Other 


6% 


89% 


5% 


Source: National Longitudinal Study of NCL.B, Teacher Survey («— 3,043 elementary teachers). 



On average, elementary teachers reported in 2006—07 that they spent 10.0 hours per week on reading 
instruction, 5.8 hours on math, 2.5 hours on science, 2.5 hours on social studies and history, 1.6 hours 
per week on art and music, 1.6 hours on physical education and health, and 1.9 hours on other subjects. 
When asked about changes in instructional time from 2004—05 to 2006—07, elementary teachers reported 
average increases in reading and math instructional time of 21 minutes and 10 minutes, respectively, and 
decreases in other subjects ranging from 1 to 5 minutes per week (-3 minutes for science, -5 minutes for 
social studies and history, and -1 minute for art and music). 

Over a longer and earlier period, from 1987—88 to 2003—04, teacher survey results from the 
Schools and Staffing Survey indicate that elementary teachers had increased instructional time 
on reading and mathematics and decreased the amount of time spent on science and social 
studies during this period. Specifically, classroom teachers in grades 1 through 4 reported spending 
11.6 hours per week on reading instruction in 2003—04, compared with 10.9 hours in 1999—2000 and 
11.0 hours in 1987—88. The amount of instructional time that these teachers reported spending on 
mathematics in 2003—04 (5.4 hours) was less than in 1999—2000 (5.7 hours) but greater than in 1990—91 
and 1987—88 (4.9 hours). Conversely, these teachers reported spending 2.3 hours per week on science 
instruction and 2.5 hours on social studies instruction in 2003—04, compared with 2.6 hours and 2.9 
hours, respectively, in 1999—2000 (see Exhibit 22). Translated into minutes, the increase in reading from 
1999—2000 to 2003—04 amounted to 42 minutes per week, while the decreases in math, science, and 
social studies amounted to 1 8 minutes, 1 8 minutes, and 24 minutes per week, respectively.’*'*'' 
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Exhibit 22 

Average Number of Hours Per Week That Public School Teachers of First- Through Fourth-Grade 
Self-Contained Classrooms Spent on Teaching Each of Four Subjects, 

Selected Years 1987-88 Through 2003-04 





1987-88 


1990-91 


1993-94 


1999-2000 


2003-04 


English/reading/language arts 


11.0 


10.5 


10.9 


10.9 


11.6 


Mathematics 


4.9 


4.9 


5.3 


5.7 


5.4 


Science 


2.6 


2.7 


3.0 


2.6 


2.3 


Sociai Studies 


2.8 


2.9 


3.0 


2.9 


2.5 


Totai of four subjects 


21.1 


21.0 


22.1 


22.1 


21.8 



Source: National Center for Education Statistics, Schools and Staffing Survey (1987-88 through 2003—04). 



The above findings about changes in instructional time present a different picture from those recently 
reported by the Center on Education Policy (CEP) based on a survey of school districts conducted in 
2006—07. CEP reported that 36 percent of all districts reported reducing instructional time in social 
studies since ATCLB took effect in 2002, 28 percent reported reductions in science, and 16 percent 
reported reductions in art and music. The average reported weekly decreases amounted to 76 minutes, 

75 minutes, and 57 minutes, respectively, in districts that reported such reductions. The CEP findings 
are based on a survey of district administrators, while the above findings from the NLS-ATCEB study are 
based on teacher reports; the CEP survey asked about change over a five-year period (2002 to 2007) 
while the NLS-iVCLB asked about change over a two-year period (2004—05 to 2006— 07). Because 
teachers are the ones who actually provide the instruction, their reports may be more reliable on this 
issue than the reports of district administrators. In addition, while from a policy perspective it may be 
preferable to report on change over a longer period (i.e., five years rather than two years), survey 
respondents may be less able to report accurately on a survey question about change in instructional 
practices over a longer time period, particularly if asked to aggregate estimated changes in instructional 
time across all teachers in the district. 

Title I schools that were identified for improvement reported experiencing a wide variety of 
interventions that NCLB designates for these schools. Most — but not all — reported the actions 
that are required for all identified Title I schools: notifying parents about the school’s improvement 
status, developing a school improvement plan, and offering students the option to transfer to a higher- 
performing school (see Exhibit 23). In the first year of improvement status, only 71 percent of Title I 
schools offered students the option to transfer to a non-identified school, but that percentage was higher 
for schools in later stages of improvement status (80 percent of schools in the second year of 
improvement status, 85 percent of schools in corrective action, and 91 percent of schools in 
restructuring status). The additional parental choice option required in schools in the second year of 
improvement status — providing low-income students with the opportunity to receive supplemental 
educational services from a state-approved provider — was reported by more than 92 percent of those 
schools, and was also reported by over half (53 percent) of schools in the ^rr/year of improvement 
status, when it was not required. 

Most Title I schools in corrective action status in 2006—07 reported experiencing the 
interventions that NCLB defines for schools in this stage of improvement status. Eighty-eight 
percent of Title I schools in corrective action reported at least one of the seven interventions listed in the 
law. The most common by far was implementing a new research-based curricula or instructional 
programs (67 percent), followed by having an outside expert appointed to advise the school (26 percent). 
Slightly more than one-fifth of the schools reported extending the length of the school day (22 percent), 
restructuring the internal organi 2 ation of the school (21 percent), or replacing school staff members 
relevant to the school’s low performance (21 percent). Several of the corrective actions were less 
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Exhibit 23 

Percentage of Identified Title 1 Schools That Reported Experiencing Various Types of 
Interventions Since Identification for Improvement, 2006-07 




Percent of 
Schools in 
Year 1 of 
Improvement 
(n=102) 


Percent of 
Schools in 
Year 2 of 
Improvement 
(n=63) 


Percent of 
Schools in 
Corrective 
Action 
(n=99) 


Percent of 
Schools in 
Restructuring 

rn=163) 


Actions Required for All Identified Title 1 Schools 


Parents were notified of schoois' improvement 
status 


94% 


100% 


100% 


96% 


District or state deveioped a joint improvement pian 
with the schooi 


83% 


96% 


94% 


86% 


Students were offered the option to transfer to a 
higher-performing schooi, with transportation 
provided 


71% 


80% 


85% 


91% 


Actions Required for Identified Title 1 Schools That Miss AYP After Identification 


Eligible students were offered supplemental 
educational services from a state-approved provider 


53% 


92% 


100% 


94% 


Corrective Actions 


Implemented a new research-based curriculum or 
instructional program 


54% 


60% 


67% 


81% 


Significantly decreased management authority at 
the school level 


4% 


17% 


1% 


13% 


Appointed outside expert to advise the school 


34% 


35% 


26% 


53% 


Extended length of school day 


15% 


26% 


22% 


44% 


Extended length of school year 


6% 


7% 


9% 


16% 


Restructured internal organization of the school 


10% 


12% 


21% 


39% 


Replaced school staff members relevant to school’s 
low performance 


4% 


11% 


21% 


30% 


Replaced the principal 


13% 


24% 


29% 


40% 


Restructuring Interventions ** 


Reopened the school as a public charter school 


2% 


7% 


0% 


1% 


Entered into a contract with a private entity to 
manage the school 


2% 


1% 


0% 


1% 


Operation of school turned over to state 


2% 


2% 


0% 


3% 


Replaced all or most of the school staff 


5% 


11% 


4% 


12% 


Exhibit reads: In 2006—07, 94 percent of Title I schools in their first year of being identified for 
improvement reported that parents had been notified of the school’s improvement status. 


* Replacing the principal is not specifically mentioned in the law as an intervention for schools in corrective action, but the principal 
may be thought of as the staff person who is most responsible for the school’s performance, so replacing the principal was included as 
a separate item on the survey. 

** In addition to the specific restructuring interventions shown here, the law also allows schools in restructuring status to make “any 
other major restructuring of the school’s governance arrangement that makes fundamental reforms, such as significant changes in the 
school’s staffing and governance.” 


Source: National Longitudinal Study of ATCLB, Principal Survey. 
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frequently reported in 2006—07 than in 2004—05; for example, Title I schools in corrective action status 
were less likely to be required to implement new curricula or instructional programs (67 percent vs. 89 
percent) or the appointment of an outside advisor (26 percent vs. 59 percent). Overall, however, there 
was not a statistically significant change in the percentage of corrective action schools that reported 
experiencing at least one of the required corrective actions (see Exhibit 24).^'"* 



Exhibit 24 

Percentage of Title 1 Schools Identified for Corrective Action That Reported 
Experiencing Various Types of Interventions, 2004-05 and 2006-07 






2004-05 

(n=74) 


2006-07 

(n=99) 


Implemented a new research-based curriculum or Instructional program 


89% 


67%* 


Appointed outside expert to advise the school 


59% 


26%* 


Extended length of school day 


45% 


22% 


Extended length of school year 


35% 


9%* 


Restructured Internal organization of the school 


21% 


21% 


Significantly decreased management authority at the school level 


27% 


1%* 


Replaced school staff members relevant to school's low performanoe 


7% 


21% 


Any of the above 


96% 


88% 


Exhibit reads: In 2006—07, 67 percent of Title I schools identified for corrective action reported that 


they had been required to implement a new research-based curriculum or instructional program, down 
from 89 percent in 2004—05. 

* Indicates significance at the 5 percent level. 

Source: National Longitudinal Study of NCLB, Principal Survey. 



Few Title I schools in restructuring status in 2006—07 reported experiencing any of the specific 
interventions listed in the law for this stage of improvement status. However, the law also permits 
districts to make “any other major restructuring of the school’s governance arrangement that makes 
fundamental reforms, such as significant changes in the school’s staffing and governance,” so schools in 
restructuring status could experience another kind of restructuring intervention that is not listed in the 
law. In addition, the law allows for schools in restmcturing status to first spend a year planning for 
restructuring and then implement the restructuring the following year (if the school misses AYP again 
for a sixth year); about half of the schools in restructuring status appeared to be in the first year of this 
status and thus not yet actually required to be implementing any restructuring actions. 

The most frequently reported restmcturing intervention was replacement of all or most of the 
school staff (12 percent in 2006—07). Very small percentages of schools in restructuring status 
reported state take-over of the school (3 percent), reopening the school as a public charter school 
(1 percent), or contracting with a private entity to manage the school (1 percent).’^™ 

Schools in restructuring status frequently reported experiencing actions that NCLB specifies for 
the “corrective action” stage of school improvement. The most common “corrective actions” 
reported by schools in restructuring status were implementing a new research-based curriculum or 
instructional program (81 percent) and appointment of an outside expert to advise the school (53 
percent). Other corrective actions reported by schools in restructuring status included restructuring the 
internal organization of the school (39 percent), extending the length of the school day (44 percent) or 
year (16 percent), and replacing school staff members relevant to the school’s low performance 
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(30 percent). Replacement of the principal, although not specifically listed in the law as a corrective 
action or restructuring strategy, was reported by 40 percent of schools in restructuring status, compared 
with 29 percent of schools in corrective action and 13 percent of schools in Year 1 of school 
improvement status.^™ 

Many of the interventions labeled as “corrective actions” under NCUi were also implemented in schools 
in earlier stages of improvement status. For example, 60 percent of Tide I schools in their second year 
of improvement were required to implement new research-based curricula or instructional programs, a 
figure not much different from that for schools in corrective action (67 percent) 

State officials noted that certain corrective actions and restructuring strategies were sometimes precluded 
by state laws (and ESELA requires that the corrective action and restructuring options that are 
implemented must be consistent with state law). Most commonly, state education agencies were barred 
from taking over schools (15 states), entering into a contract with a private entity (eight states), replacing 
school staff (seven states), and re-opening a school as a public charter school (seven states). Even where 
not prohibited by state law, some state officials expressed reluctance to use the state takeover strategy, 
and others noted that replacing staff could prove difficult because of collective bargaining agreements or 
union presence.' 

Districts took multiple actions in response to being identified for improvement, most commonly 
offering or requiring specific professional development for teachers (91 percent of identified 
districts) (see Exhibit 25). Other actions ftequendy taken by identified districts included increased 
monitoring of instruction and student performance at school sites (85 percent), offering or requiring 
specific professional development for principals (70 percent), and reallocating fiscal resources to target 
specific needs (64 percent). In most cases, the percentage of districts reporting a particular action in 
response to being identified increased from 2004—05 to 2006—07, sometimes more than doubling. For 
example, 36 percent reported hiring a consultant to advise the district on effective strategies in 2006—07, 
up from 11 percent in 2004—05. However, identified districts were less likely to report distributing test 
preparation materials to their schools in 2006—07 than in 2004—05 (49 percent vs. 67 percent)." 

F. Accountability Under Other State Initiatives 

About half of the states have implemented accountability requirements that differ from what is 
required under NCLB (27 states in 2006-07, up slightiy from 24 states in 2004-05). These state 
requirements used designations of school performance that differed somewhat from those of NCEB or 
reported their results in different ways. For example, some used letter grades that were based on criteria 
other than AYP, others identified “high-improving” schools, and so forth. Fourteen states used 
different measures of student achievement (for example, tests in subjects not required under ATCLB). 

A continuing difference was that many of these states (1 5) relied on growth measures to track progress 
toward accountability targets instead of an absolute target (i.e., percentage of students reaching the state’s 
proficient level) as in NCLJi. (Seven of the 15 states that used growth measures for their non-ATCEB 
accountability systems were also approved for the Department’s growth model pilot project, but the 
growth measures they reported using in fall 2006 for their non-NCEB accountability system are generally 
quite different from the growth models approved under the pilot project. The most common difference 
is that the non-NCEB growth measures do not have a 100 percent proficiency requirement by 2014, 
which means that growth may be significant in a state system but not acceptable under NCEB because it 
is not sufficient to reach universal proficiency in the specified timeframe.'*’) 
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Exhibit 25 

Percentage of Districts Taking Various Actions in Response to 
Being Identified for Improvement, 2004-05 and 2006-07 




2004-05 


2006-07 


Offered or required specific professional development for teachers 


80% 


91% 


Increased district monitoring of Instruction and student performance at school sites 


61% 


85% 


Offered or required specific professional development for principals 


59% 


70% 


Reallocated fiscal resources to target specific needs (e.g., particular groups of students, 
subjects, or schools) 


51% 


64% 


Developed or revised district content standards 


24% 


39% 


Distributed test preparation materials to some or all schools 


67% 


49% 


Implemented a districtwide curriculum In reading 


39% 


40% 


Hired a consultant to advise district administrators on effective strategies 


11% 


36% 


Implemented a dIstrIctwIde curriculum In mathematics 


17% 


32% 


Reorganized the district office staff to increase efficiency or focus on instruction 


23% 


29% 


Changed the budget allocation formula for schools 


10% 


21% 


Implemented new personnel procedures for hiring or assigning principals and teachers 


8% 


23% 


Created smaller schools, or schools-within-schools 


11% 


12% 


Exhibit reads: In 2006—07, 91 percent of identified districts reported that they had offered or required 
specific professional development for teachers in response to being identified for improvement. 

Source: National Longitudinal Study of NCLB, District Survey (n=75 districts in 2004—05, 95 districts in 2006—07). 



States’ NCLB accountability systems and other state or district accountability initiatives did not 
commonly generate conflicting designations of high- and low-performing schools, according to 
principal reports for 2006—07. As was the case in 2004—05, few schools identified as low-performing 
under NCUi were identified as high-performing under their state or district accountability system, or 
vice versa. Among principals who said their school was identified for improvement under NCIJi, only 
2 percent reported that their school had been designated as high-performing under a state or district 
accountability initiative. Conversely, among principals who said their school was not identified for 
improvement under Tide I, only 3 percent reported that their school had been designated as low- 
performing under a state or district accountability initiative. (In a similar analysis in Florida, Peterson 
(2006) found a high degree of inconsistency between schools’ AYP status under NCUi and their 
accountability designations under the state’s “A-f ” accountability system. The NLS-A^CLB data 
discussed above also indicated that Florida schools often receive conflicting accountability designations 
under NCUi and the state’s A-f system; however, across the entire NLS-ATCLB sample, there were few 
cases in which principals reported receiving conflicting designations in other states.**") 

Principals who said they operated under state or district accountability initiatives, as well as under JVCU3, 
gave mixed reports about the benefits and drawbacks of multiple approaches to accountability. While 
nearly two-thirds of these principals (65 percent) said that the multiple initiatives gave them a more 
complete picture of their school’s effectiveness, 37 percent said they resulted in staff confusion about 
targets for student achievement.**'’ 
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IV. School Choice and Supplemental Educational Services 



In Title I schools that have been identified as in need of improvement, NCLJi provides parents with new 
options for their children, including the option to transfer to another public school or to receive 
supplemental educational services (most commonly, after-school tutoring). Districts are required to 
offer students the option to transfer to another school in the first year that a school is identified for 
improvement. All students in the school are eligible for this option, and the district must provide 
transportation for participating students. Supplemental educational services are not required until an 
identified school misses AYP again (for a third time),*'" and only students from low-income families are 
eligible to receive the services; the district is not required to provide transportation. 

States must develop criteria for approving supplemental service providers, as well as monitoring the 
performance of participating providers. Districts must notify parents of their school choice and 
supplemental service options and disseminate information about school performance and provider 
qualifications and effectiveness that parents need to make informed decisions. Each district that must 
offer these options must allocate an amount equal to 20 percent (or more) of its Tide I, Part A, 
allocation to provide supplemental services and transportation for students using the school choice 
option, unless a lesser amount is needed to satisfy all requests. In addition, each such district must make 
available, for each child receiving supplemental services, an amount equal to the district’s Title I, Part A, 
allocation per low-income student, unless the actual cost of such services is less than that amount. 



Key Evaluation Questions for School Choice and Supplemental Educational Services 

1 . How many students are eligible to participate in the Title I school choice and supplemental services 
options, and how many actually do so? What are the characteristics of participating students? 

2. How and when do districts inform parents of eligible children about the Title I school choice and 
supplemental services options? 

3. What are the characteristics of the supplemental services that students receive? 

4. What is the relationship between participation in Title I school choice and supplemental services and 
student achievement? 

5. How are states monitoring and evaluating the effectiveness of supplemental service providers? 



A. Eligibility and Participation 

The number of students eligible for the two Title I choice options rose considerably from 2003— 
04 to 2006—07. The number eligible for Tide I school choice increased from 3.3 million to 5.5 miUion, 
while the number eligible for supplemental services increased from 1.9 miUion to 3.6 miUion.*" More 
students are eligible for the choice option because it applies to all identified schools and all students in 
those schools are eligible, whereas the supplemental services option only applies to identified schools 
that have missed AYP for three or more years and only students from low-income families are eligible. 
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Although more students 
were eligible to 
participate in the Title I 
school choice option, a 
larger number actually 
participated in the 
supplemental 
educational services 
option. The number of 
students receiving 
supplemental educational 
services in 2006—07 
(530,000) was four times 
as large as the number 
participating in the school 
choice option (120,000) in 
that year (see Exhibit 
26) .1™ 

Student participation 
rates varied widely 
across states and school 
districts. Based on state- 
reported data for 2006—07, 
participation rates in the 
school choice option 
ranged from 0 to 6 percent 
across the states, while 

participation rates for supplemental services ranged from 0 to 47 percent.'™ In districts that were 
required to offer the school choice option in 2005—06, 57 percent reported that they had no students 
participating that year, while 31 percent reported participation of between 0.01 to 2.0 percent of eligible 
students, and 12 percent reported participation rates of more than 2.0 percent. In districts required to 
offer supplemental services in 2005—06, 31 percent reported that they had no students participating; one- 
quarter reported participation rates of less than 5 percent, 21 percent reported participation rates 
between 5 and 20 percent, and 24 percent reported participation rates higher than 20 percent.'^ 

Student participation in the supplemental services option more than doubled from 2003—04 to 
2006—07, rising from 244,000 to 530,000 participants. During the same period, the number of students 
participating in the Tide I school choice option nearly quadrupled from 32,000 to 120,000 participants 
(see Exhibit 26). Participation rates for supplemental services increased from 14 percent in 2003—04 to 
19 percent in 2004—05 and then declined to 14 percent in 2006—07. Although the number of participants 
rose in 2006—07, the increase did not keep pace with the rise in the number of eligible students. 
Participation rates for school choice rose from 1.0 percent in 2003—04 to 2.2 percent in 2006—07.*^ 

Districts were required to offer school choice in 17 percent of aU Title I schools and were 
required to offer supplemental services in 10 percent of Title I schools. The two options were 
more likely to be required in high-poverty Title I schools (34 percent and 23 percent, respectively) and 
were rarely required in low-poverty schools (5 percent and 2 percent, respectively) 



Exhibit 26 

Number of Students Participating in Titie I Schooi Choice and 
Suppiementai Educationai Services, 2003-04 to 2006-07 




Exhibit reads: The number of students participating in Tide I school 
choice rose from 32,000 in 2003—04 to 120,000 in 2006—07. 

Note: For 2006—07, the U.S. Department of Education changed its guidance and 
instructed states to include all students who transferred from a school identified for 
improvement to a non-identified school, regardless of whether students transferred 
under Title 1 school choice or another choice option. 

Source: Consolidated State Performance Reports. 
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Most districts required to 
offer Title I school 
choice reported doing so 
at the elementary level 
but were less likely to do 
so in middle and high 
schools. Most districts 
not offering school 
choice did not have any 
non-identified schools at 
the relevant grade level. 

In 2006—07, 67 percent of 
districts with elementary 
schools identified for 
improvement reported that 
they offered the school 
choice option at the 
elementary level, compared 
with 41 percent at the 
middle school level (an 
increase from 20 percent in 
2004—05) and 22 percent at 
the high school level (see 
Exhibit 27) About half 
of districts required to 
offer school choice at the 
middle school level, and 
about two-thirds at the 
high school level, did not 
have any non-identified 

schools at that grade level (which can occur when there is only one school per grade level or when there 
are multiple schools but all have been identified for improvement) . 

Districts that did offer choice continued to account for a majority of students who were eligible 
for the school choice option, suggesting that districts offering school choice tended to be large. 

Districts that were subject to the school choice requirement but did not have any non-identified schools 
available accounted for a small percentage of students (at the high school level, for example, they 
represented 58 percent of districts required to offer choice but only 14 percent of students in such 
districts), indicating that these districts tended to be small.'™ 

AH districts required to offer supplemental services reported that there was at least one state- 
approved supplemental service provider available to serve their students. The supply of approved 
providers has grown considerably since the early years of NCLB implementation. Nationwide, states 
reported approving a total of 3,234 supplemental service providers as of May 2007, more than three 
times as many as had been approved four years earlier, in May 2003, when the number was 997.*™ 

District expenditures on Title I choice options doubled from 2003—04 to 2005—06, based on 
district survey responses. Total spending on Tide I supplemental educational services was estimated at 
$375 million for 2005—06, up from $192 million in 2003—04. Spending on transportation for Tide I 
school choice pardcipants was esdmated at $56 million for 2005—06, compared with $24 million in 



Exhibit 27 

Percentage of Districts Reporting That They Offered Titie i Schooi Choice, 
By School Grade Level, and Percentage of Students in Such Districts, 
Among Districts Required to Offer School Choice, 2006-07 



Elementary Schools 



Middle Schools 



High Schools 



Elementary Schools 



Middle Schools 



High Schools 




Exhibit reads: Among districts that were required to offer school choice at 
the elementary level in 2006—07, 67 percent reported that they were offering 
school choice; these districts accounted for 94 percent of all students in 
districts required to offer school choice at the elementary level. 



Source: National Longitudinal Study of NCLB, District Survey (»=108 districts with 
identified elementary schools, 114 with identified middle schools, and 54 with identified high 
schools). Data on whether all of a district’s schools at a particular grade level were identified 
for improvement are from the Study of State Implementation of Accountability and Teacher 
Quality Under NCLB. 
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2003—04. The percentage increase in spending on these two Title I choice options (133 percent for 
school choice and 95 percent for supplemental services) was roughly comparable to the percentage 
increase in participation over the same two-year period (103 percent and 104 percent, respectively). 

The average maximum amount that districts reported allocating for supplemental services decreased 
from $1,434 per pupil in 2004—05 to $1,134 in 2005—06, while the total number of participants increased 
from roughly 446,000 to 530,000. Districts reported spending an average of $836 per student enrolled in 
supplemental services in 2005—06, about 26 percent less than the maximum per-child amount they 
reported allocating for such services in that year ($1,1 34) 

The National Longitudinal Study of NCLB, in addition to surveying a nationally representative sample of 
districts and schools, also surveyed a total of 1,867 responding parents in a subsample of eight large 
urban school districts. Because the sample of eight districts was not nationally representative, findings 
based on this sample cannot be generaU 2 ed to the nation. 

Parent survey results in eight urban districts indicate that the parents’ main reasons for 
participating in either the school choice or supplemental services option was to better meet 
the educational needs of their child. Among parents who transferred their child to a new school, 
most parents used the choice option because they thought the quality of teaching at the new school was 
better (62 percent) and the previous school was not meeting their child’s needs (62 percent). 

Additionally, 47 percent of parents thought their child’s new school was safer (see Exhibit 28).'™ 



Exhibit 28 

Parents’ Most Frequently Reported Reasons For Choosing to Participate or Not Participate in 
Title I School Choice and Supplemental Educational Services, in Eight Large Urban Districts, 2006-07 





Most Common Reasons for Participating 


Most Common Reasons for Not Participating 


School 

Choice 


The quality of teaching at the new 
school is better. 


62% 


1 was satisfied with the quality of 
teaching at my child's school. 


63% 


My child's old school was not meeting 
his/her needs. 


62% 


My child's school is located in a 
place that is easy to get to. 


60% 


Supplemental 

Educational 

Services 


Tutoring is free. 


53% 


My child doesn’t need help. 


46% 


There is tutoring in the subject area(s) 
in which my child needs extra help. 


51% 


Tutoring is given at times that are 
not good for my family. 


35% 



Exhibit reads: In a sample of eight urban districts, 62 percent of parents participating in the school 
choice option said the reason was that the quality of teaching at the new school was better. Among 
eligible parents who did not participate, 63 percent said the reason was that they were satisfied with the 
quality of teaching at their child’s school. 

Source: National Longitudinal Study of NCL,B, Parent Survey (n=125 to 452 parents; see Appendix Exhibits A-33 to A-36). 



Among parents who chose to participate in supplemental services, 53 percent said they participated 
because tutoring was free and 51 percent participated because tutoring was offered in subjects in which 
their child needed extra help.'™* 

In 2006—07, parents who were notified of the school choice option chose not to transfer because they 
were satisfied with the teaching at their child’s school (63 percent) and because their child’s school was 
easy to get to (60 percent). Two years prior, 75 percent of parents kept their children in their current 
school because of its location and less than half (47 percent) were satisfied with the quality of teaching at 
the current school. In 2006—07, almost half (46 percent) of parents did not enroll their child in 



36 




























supplemental services because they did not believe their child needed help. In 2004—05, 28 percent of 
parents listed that as a reason. Similarly, in 2006—07, 35 percent of parents said they did not enroll their 
child in supplemental services because tutoring was not offered at a convenient time, compared to 47 
percent in 2004—05.'™“ 



B. Parental Notification 

Districts that were required to offer Title I school choice and supplemental services in identified 
schools most frequently reported notifying parents about their choice options through written 
notification materials in English (99 percent and 91 percent, respectively), but they also used 
other strategies to communicate with parents (see Exhibit 29). Over half of the districts provided 
written notification in at least one language other than English, held individual meetings with interested 
parents, and included notices in district or school newsletters. Between the 2004—05 and 2005—06 school 
years, districts increased the number and types of communication strategies that they used for 
communicating with parents. For example, the percent of districts that worked with a local community 
partner to facilitate communication almost doubled, from 10 percent to 17 percent for school choice and 
from 16 percent to 33 percent for supplemental services. Similar to findings from 2004—05, large districts 
in 2005—06 were more likely to use each type of notification strategy.'™ 



Exhibit 29 

District Strategies for Communicating With Parents About 
Title 1 School Choice and Supplemental Service Options, 2004-05 and 2006 


-07 




School Choice 


Supplemental Services 




2004-05 


2006-07 


2004-05 


2006-07 


Written notification in English 


68% 


99% 


94% 


91% 


Written notification in language(s) other than 
English 


47% 


59% 


53% 


67% 


Individual meetings with interested parents 


52% 


61% 


78% 


63% 


Notices in district or school newsletters 


40% 


53% 


64% 


50% 


Enrollment fairs or open houses 


19% 


22% 


51% 


63% 


Working with a local community partner 


10% 


17% 


16% 


33% 


Exhibit reads: In 2006—07, 99 percent of districts reported sending written notification in 
English about children’s school choice options, compared with 68 percent in 2004—05. 


Source: National Longitudinal Study of NCLB, District Survey (2004—05, »=156 districts for school choice and 109 
districts for supplemental services; 2006—07, »=156 districts for school choice and 129 districts for supplemental 
services). 



However, despite these communication efforts, a survey of eligible parents in eight urban school 
districts found that many were unaware of their Title I choice options and did not think they 
had been notified about them. Among parents with a child eligible for the Tide I school choice 
option, only 20 percent said they had received notification about this option from the school district, 
while 59 percent of parents with a child eligible for supplemental services said they had been notified. 
Among parents whom the district had identified as having a child actually participating in Tide I 
supplemental services, 81 percent said they had been nodded and 15 percent said they had not been 
notified about this opdon.'’^’^ 
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In addition, the timing of 
parental notification was 
often too late for parents to 
choose a new school before 
the start of the school year, 
though there was 
improvement from 2004-05. 

Based on a nationally 
representative survey of 
districts, 43 percent of affected 
districts notified parents about 
the school choice option 
before the beginning of the 
2006—07 school year, an 
increase from 29 percent in 
2004—05 (see Exhibit 30). 

Another 1 5 percent notified 
parents at the beginning of the 
school year, which would have 
given parents very Utde time to 
make important decisions 
about which school their child 
should attend. The remaining 
42 percent of districts notified 
parents after the school year 
had already started; in these districts, notification occurred, on average, five weeks after the start of the 
school year. Among districts required to offer Tide I school choice, 42 percent notified parents of 
eligible students before the start of the school year. 

One reason for the delay in notifying parents about their choice options may be that some states did not 
provide final determinations about schools’ AYP and identification status until late in the summer or, in 
some cases, after the school year had begun. States have improved on their timing of providing 
determination about schools’ AYP and identification status: while only seven states provided districts 
with preliminary school identification results before August in 2004—05, 24 states provided districts with 
that information in 2006—07. Twenty-two states provided preliminary results in August, and six 
provided preliminary results later than August — a slight increase from the 20 states that provided results 
after August in 2004—05. Final results continue to often come after August.'™* 

Districts that notified parents about the school choice option before the first day of school had 
higher participation rates than districts that notified parents on or after the first day of school. 

In 2006—07, in districts where parents were notified about school choice options before the start of the 
school year, 1 .4 percent of eligible students participated. In contrast, in the districts that did not notify 
eligible parents until after school started, the participation rate was only 0.1 percent. This result is 
consistent with the result of parent survey data, which show that in a sample of eight urban districts, 
parents who took advantage of the school choice option were substantially more likely to say they had 
been informed before the start of the school year (62 percent) than were parents who kept their children 
in identified schools (26 percent) .*™“ 



Exhibit 30 

Timing of Parent Notification About Titie i Schooi Choice, 
As Reported by Schooi Districts, 2004-05 and 2006-07 



Before the start of 
the school year 



At the start of the 
school year 



After the start of 
the school year 



43% 




1 29% 


□ 2006-07 




■ 2004-05 



49% 

40% 60% 

Percent of Districts 



Exhibit reads: In 2006—07, 43 percent of school districts required 
to offer Title I school choice reported notifying parents about this 
option before the start of the school year, up from 29 percent in 
2004-05. 



Source: National Longitudinal Study of NCLJi, District Survey (2004—05, »— 181 
districts; 2006-07, »=132 districts). 
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Teachers sometimes played a significant role in communicating with parents about the Title I 
choice options, particularly the supplemental services option. Among parents choosing to 
participate in one of these options in eight urban school districts, 1 1 percent of school choice 
participants said that a reason for transferring their child to a non-identified school was that the child’s 
previous teacher thought he or she should move, and 53 percent of parents choosing supplemental 
services said that their child’s teacher thought the child needed the extra help. In schools in which 
students were eligible to receive supplemental services, 40 percent of teachers reported talking with 
parents about supplemental services. Among teachers who knew that some of their own students were 
eligible for the services, 54 percent said that they encouraged parents to apply, and 29 percent said that 
they advised parents on choosing a particular provider.'^’^'" 

C. Characteristics of Supplemental Educational Services 

Most participating students received supplemental educational services from a private provider. 

In 2005-06, private providers served 76 percent of participating students, up from 58 percent in 2003-04. 
During the same period, the share of participants served by school districts and public schools declined 
from 34 percent to 13 percent.'’'’^'" In 2005-06, 39 percent of student participants were served by national 
for-profit companies, while 10 percent were served by other for-profit companies, 7 percent by 
community-based organizations, and 1 percent by faith-based organizations. Colleges and universities 
served 1 percent of student participants.'^^™ 

The total number of state- 
approved providers tripled 
from May 2003 to May 
2008, with most of the 
growth occurring among 
private providers. The 
number of approved 
providers rose from 1,024 in 
May 2003 to 3,050 in May 
2008 after reaching a high of 
3,234 providers in May 2007 
(see Exhibit 31). Private 
non-profit and for-profit 
organizations accounted for 
86 percent of approved 
providers in 2007, up from 
60 percent of aU providers in 
2003; the number of private 
providers rose from 618 in 
2003 to 2,688 in 2008. 

School districts and public 
schools accounted for 10 
percent of providers in 2008, 
down from 33 percent five 
years earlier; their numbers 
initially increased, from 329 
in 2003 to 471 in 2005, and 
then declined to 291 in 2008. 



Exhibit 31 

Number of State-Approved Suppiementai Educationai 
Service Providers, by Provider Type, May 2003 to May 2008 




2003 2004 2005 2006 2007 2008 



Exhibit reads: In May 2003, there were a total of 1,024 providers 
approved by states to provide supplemental educational services, 
including 618 private providers, 329 school districts and public schools, 
and 77 other types of providers (such as colleges and community-based 
organizations) . 

Source: Policy and Program Studies Service review of state-approved provider lists 
posted on state education agency Web sites. 
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Other types of providers such as colleges, universities, and community-based organizations accounted 
for 2 percent of approved providers in 2008 (71 providers). A growing number and percentage of faith- 
based organizations have obtained state approval, rising from 1 8 providers (2 percent of aU providers) in 
2003 to 201 (7 percent) in 2008; however, faith-based providers serve a small percentage of students (less 
than 1 percent in 2005— 06).'=^™* 

Based on a survey of supplemental service providers in 16 geographically diverse districts, 
participating students attended an average of 45 hours per year in those districts in 2005— 06, 

which is about one-third the amount of instructional time provided in the typical after-school program 
(134 hours). The providers reported an average of about five hours of services per week, similar to the 
amount reported by parents of participating students in a sample of eight urban districts. School districts 
tended to report a lower intensity of services than did the providers or parents. About half (48 percent) 
of districts said that participating students received one to two hours per week of services, and an 
additional one-third (25 percent) said students received three hours per week; 27 percent said students 
received four or more hours per week. Provider reports indicated that students attended, on average, 

76 percent of the sessions.'™ 

In the 16 districts, providers grew in the size of their staffs from 2004—05 to 2006—07, while the 
experience level of their staff declined somewhat. In 2006-07, the average-size provider in these 
districts had 79 staff, more than twice as many as in 2004—05 (36). One in three providers had 50 or 
more staff in 2006—07, up from 15 percent in 2004—05. Average years of staff tutoring experience for 
these providers declined from nearly 10 years to seven years between 2004—05 and 2006—07, and the 
percentage of staff with three or fewer years of experience increased from 10 to 20 percent over the two 
years. At the same time, these providers became less likely to rely on fuU-time teachers from the district 
in which they operated (declining from 58 percent to 38 percent) or to employ teachers who tutor some 
of the same students whom they also teach in their regular classrooms (declining from 19 percent to 10 
percent) 

Services were provided both through one-on-one tutoring and through group instruction. Over 
half of the providers in the 16 districts said that students were often or always served one-on-one or in 
small groups (53 percent and 37 percent, respectively), while 26 percent said services were often or 
always provided in large groups. Thirty-three percent said their services were always one-on-one, while 
20 percent said services were always provided in small groups and 11 percent said services were always in 
large groups.'™* 

D. Relationship Between Participation in Title I Choice Options and Student 
Achievement 

The National Longitudinal Study of NCLB included the collection of student-level state assessment data 
in nine large urban school districts in order to examine the relationship between participation in the 
Tide I school choice and supplemental educational services options and student achievement. The nine 
districts were selected based on availability of the necessary longitudinal individual student achievement 
data and sufficient numbers of students participating in the Tide I school choice and supplemental 
services opdons, to enable sampling of about 1 00 students in each district who were pardcipadng in the 
Tide I school choice opdon and an addidonal 100 students who were receiving Tide I supplemental 
services. Due to data Umitadons in some of the districts, the final analysis included a smaller number of 
districts: seven districts for the supplemental services analysis, and six districts for the school choice 
analysis. The analysis used a quasi-experimental fixed-effects model that compared the achievement 
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trajectories of individual students before and after participating with those of nonparticipating 
students.*^™ 



Across the sample of seven districts, student participants in supplemental educational services 
experienced gains in achievement in both reading and mathematics that were greater than the 
gains for nonparticipating students. On average, the effect sries measured were 0.08 of a standard 
deviation unit in both reading and math for students that participated in supplemental services during 
one school year and 0.15 to 0.17 for students that received supplemental services during two or more 
years (see Exhibit 32). African-American students, Hispanic students, and students with disabilities all 
showed positive achievement effects from participating in supplemental educational services. Looking at 
the districts individually, positive effects were found in five of the seven districts; the remaining two 
districts had relatively small sample sEes (see Exhibit A-37 in Appendix A). 



Exhibit 32 

Achievement Gains for Student Participation in 
Title 1 Supplemental Educational Services and School Choice, 
In Six to Seven Districts, 2002-03 Through 2004-05 






Supplemental Services 


School Choice 




(in Seven Districts) 


(in Six Districts) 




Reading 


Mathematics 


Reading 


Mathematics 


Overall effect 


.09* 


.08* 


-.02 


-.01 


First-year effect 


.08* 


.08* 


-.02 


-.02 


Effect of two or more years 


.18* 


.15* 


-.05 


-.03 


Effects for African-American students 


.10* 


.12* 


.02 


-.03 


Effects for Hispanic students 


.10* 


.09* 


-.03 


-.02 


Effects for students with disabilities 


.05 


.17* 


-.29* 


-.13 


Exhibit reads: Students participating in Title I supplemental educational services in seven 


districts had, on average, a statistically significant math achievement gain of 0.09 of a standard 
deviation above the overall district mean. 

* Indicates significance at the 5 percent level. 


Source: National Longitudinal Study of NCLB, Analysis of Title I Choice Options in Nine Urban Districts. The sample 


included 47,599 to 48,499 students for the supplemental services analysis and 2,754 to 3,184 students for the school 
choice analysis. 



To interpret the magnitude of these achievement gains, three potential benchmarks may be referred to: 
the gain in student achievement of an additional year of learning, the si 2 e of the achievement gap 
between minority and white students, or the gains obtained by other education interventions such as 
class si 2 e reduction or comprehensive school reform. Compared with these benchmarks, the reading 
and math gains from participating in Tide I supplemental educational services during one school year can 
be interpreted as: a) approximately equivalent to 1 .7 to 2.4 months of additional classroom instruction 
for a fourth-grade student and 2.5 to 2.7 months of additional classroom instruction for a seventh-grade 
student; b) a one-tenth to one-seventh decrease in the gap between minority and white students; or c) a 
small effect relative to class si 2 e reduction but equivalent to the lower-bound of effects of 
comprehensive school reform or of out-of-school programs.'™*" 

For Title I school choice, the study did not find a statistically significant relationship between 
participation and student achievement. Across six districts with a sufficient sample of participating 
students, participation in Tide I school choice was not associated with a stadsdcaUy significant effect on 
achievement, overall or after muldple years in the chosen school, with the exception of students with 
disabiUdes, who showed a negadve effect in mathemadcs (see Exhibit 31; for individual district results. 
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see Exhibit A-38 in Appendix A). However, sample si 2 es for the school choice analysis were 
substantially smaller, due to the relatively small number of participants, which reduced the power of the 
analysis to detect effects and suggests that caution is warranted in interpreting these results. 

It is important to note that although this study used statistical methods to control for student 
socioeconomic background, race and ethnicity, and other factors, the quasi-experimental 
methods used in this study may not fully control for selection bias. In other words, students who 
choose may be different from students who do not choose, and these differences may affect the results. 
A study that randomly assigns students to participate in supplemental services and school choice would 
provide stronger evidence about the effects of these options on student achievement. 

E. Monitoring and Evaluation of Supplemental Service Providers 

States reported that they are working to develop and implement systems for monitoring the 
performance of supplemental service providers, but as of early 2007, eight states had not 
established any monitoring processes and 24 states had not finalized their monitoring processes. 

In 2006—07, the most common approaches states had implemented to monitor providers were surveying 
the districts, parents, or students about provider effectiveness (13 states), using providers’ reports of 
student enrollment or attendance (13 states), and examining test scores (10 states). In 2004—05, the most 
common monitoring process was surveying the districts about provider effectiveness (25 states). 
However, in 2006—07 only eight states reported that monitoring was a task that was left to the discretion 
of school districts.'’^™ 

As of fall 2006, 33 states had started an evaluation of supplemental service providers and another 1 0 
states anticipated starting evaluations later in the 2006—07 school year. In 1 8 states, the state education 
agency was, or will be, conducting the evaluation, while 22 states had hired an external evaluator to 
conduct the evaluation. One state was using both approaches and one had not yet decided on its 
approach. Thirty-three states planned to evaluate provider effectiveness by examining student 
achievement on state assessments for participating students and 12 of these states planned to use a 
matched control group. Twenty-two states planned to use provider-developed tests. Additionally, 27 
states collected data on client satisfaction (primarily students and parents), six had a measure of student 
attendance, and five used school grades as evaluation data.*^^^'" Twenty-four states had a policy for 
withdrawing approval from providers and 13 states had exercised this power. SUghdy over 80 providers 
had been removed from approved lists, with the majority in two states.'^™ 

Although the law assigns the responsibility for monitoring providers to states, not districts, a 
survey of supplemental service providers operating in 16 school districts found that the providers 
reported more frequent monitoring by districts than by states. For example, almost half (49 
percent) of the providers said that district staff observed supplemental service sessions at least a few 
times a year, compared with only 24 percent that experienced this frequency of observations by state 
staff.*™™ Similarly, the providers reported more frequent monitoring from districts than from states in a 
variety of other ways, including tracking of state achievement test scores of participating students; 
tracking of grades, grade promotion, and graduation rates; meeting with provider organizations to 
discuss implementation; and reviewing reports of student attendance rates.*™™* 
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V. Highly Qualified Teachers and Professional Development 



Ensuring that every child is taught by a teacher with strong content knowledge is one of the central goals 
of the No Child Left Behind Act. NCUi requires aU teachers of core academic subjects to be highly 
qualified, which the law defines as having: (1) a bachelor’s degree; (2) fuU state certification; and (3) 
demonstrated competency, as defined by the state, in each core academic subject that they teach.'=‘=‘“ To 
demonstrate subject-matter competency, the law requires new elementary teachers to pass a rigorous 
state test; new secondary teachers must either pass a subject-matter test or have a college major (or 
course work equivalent), advanced degree, or advanced certification in the subject(s) they plan to teach. 
For veteran teachers, the law allows each state to create its own high objective uniform state standard of 
evaluation (HOUSSE) to measure subject-matter competency. Teachers were required to meet these 
requirements by the end of the 2006—07 school year. 

NCLJi makes professional development a key strategy for improving teachers’ skiUs and effectiveness. 
For example. Tide I schools that have been identified for improvement must reserve 10 percent of their 
Tide I aUocadons for professional development. The quality of that professional development is 
cridcally important if it is to have the intended effect of improving instrucdon and student learning. 



Key Evaluation Questions for Highly Qualified Teachers and Professional Development 

1 . Flow have states implemented the requirements to define highly qualified teachers and develop a 
high objective uniform state standard of evaluation (HOUSSE)? 

2. How many teachers meet the NCLB requirement to be highly qualified? How does this vary across 
states, schools, and types of teachers? What strategies are districts using to recruit and retain highly 
qualified teachers? 

3. To what extent are teachers participating in professional development activities that are sustained, 
intensive, and focused on instruction? 



A. State Implementation of Highly Qualified Teacher Requirements 

While two of the NCLB teacher quality requirements are fixed (a bachelor’s degree and full state 
certification), states have considerable latitude in the standards and procedures they may establish for 
teachers to demonstrate competency in the subjects they teach. States may consider a wide variety of 
measures of teacher qualifications, including college major or course-taking, professional development, 
years of teaching experience, scores in licensure examinations, and other factors. However, research on 
the impact of specific measures of teacher qualifications on student achievement has often found mixed 
results, and states must make decisions about how to implement the highly qualified teacher provisions 
without a strong evidentiary basis for many of the requirements they are likely to put in place. 

For example, some research suggests that teachers who have strong preparation in the subjects they 
teach are more effective than teachers without strong subject-area preparation. However, the research 
studies with consistent findings on this have generally been limited to studies of high school math and 
science teachers. These studies have found that high school math and science teachers with a major in 
these subjects are more likely to produce higher levels of student achievement than are teachers of math 
and science who lack a major in the these subjects.’"^ At the elementary level, one study found that 
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elementary teachers with a degree in math or EngUsh were not more Ukely to produce better 
achievement outcomes for their elementary students (compared with teachers who did not have a degree 
in math or EngUsh). With respect to Ucensure exams, several research studies have found that teachers 
with higher scores on some of the Praxis II exams are somewhat more Ukely to produce higher 
achievement outcomes for students.’^™ However, research has not found this relationship between 
teacher scores and student achievement to hold true for each of the different Praxis II exams.““ More 
rigorous research is needed on the relationship between specific measures of teacher quaUfications and 
teacher effectiveness in the classroom. 

To meet the requirement to test new teachers’ content knowledge, most states used the Praxis 
II subject assessments developed by the Educational Testing Service (ETS). Based on an analysis 
of the ETS Web site and state Web sites in November of 2007, 40 states used one or more of the 
various Praxis II examinations, including 30 that used the Praxis II exams alone and 1 0 that used the 
Praxis II exams as well as other exams. Twelve states did not use the Praxis II exams but used other 
exams, such as tests developed for use in specific states (e.g., the Massachusetts Test for Educator 
Licensure) 

States varied 
considerably in the 
quaUfying scores they 
used on Praxis II 
subject assessments for 
initial teacher 
certification and for 
determining whether 
teachers are highly 
qualified under NCUi 
(see Exhibits 33 and A- 
39). States set different 
qualifying scores (often 
called cut scores or 
passing scores) for 
reasons involving each 
state’s individual 
context and challenges. 

Each state assembles a 
panel of experts that 
reviews the test and 
recommends a cut score 
to the state licensing 
board or state 
department of 
education.’^" As of 
November 2007, 22 of 
the 36 states that used 
the Praxis II 
Mathematics Content 

Knowledge exam set their cut scores below the national median and nine states set theirs below the 25th 
percentile (ranging from the 12th to the 24th percentile).’^™ In contrast, three states set their cut scores 
above the national median. 



Exhibit 33 

State Cut Scores for Praxis ii Assessment of 
Teacher Content Knowiedge in Mathematics 




Exhibit reads: State devel cut scores on the Praxis II: Mathematics Content 
Knowledge assessment vary considerably; nine states set their cut scores below 
the score that reflects the 25th percentile of all test takers between October 2004 
and July 2007, while three states set their cut scores above the 50th percentile. 

Note: Praxis scores may vary from a minimum of 100 to a maximum of 200. 

Source: Study of State Implementation of Accountability and Teacher Quality Under NCI 
(n=33 states and the District of Columbia). 
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For veteran teachers, all states offered a HOUSSE option as of 2006— 07, but all but two states 
were phasing out the use of HOUSSE for most teachers. Because HOUSSE only applies to veteran 
teachers, it therefore became somewhat irrelevant after highly qualified determinations were made for 
these teachers (but teachers who were designated as highly qualified under HOUSSE still retain that 
status). In September 2006, Secretary Spellings clarified that although states were encouraged to 
discontinue use of the HOUSSE provisions, they could continue to use HOUSSE for three specific 
groups of teachers, including “secondary school teachers teaching multiple subjects in eligible rural 
districts who were highly qualified in one subject at the time of hire; special education teachers teaching 
multiple subjects who were highly qualified in language arts, mathematics, or science at the time of hire; 
and teachers from other countries teaching here on a temporary basis. 

In early 2007, eight states indicated that they were discontinuing HOUSSE entirely, and another 11 states 
were discontinuing HOUSSE except for the allowable categories of teachers. However, 29 states 
reported that while they were working to discontinue HOUSSE, they had identified additional, very 
specific groups of teachers for whom they anticipated that HOUSSE would be necessary. For example, 
under ATCEB, teachers of foreign languages are required to demonstrate subject matter competency, and 
one way in which teachers can do so it by passing a test of teacher knowledge. In Latin, however, one 
state asserted that there was no appropriate test of teacher knowledge, so that state planned to continue 
to use HOUSSE for Latin teachers. 

As of September 2007, the most common type of HOUSSE option allowed teachers to 
accumulate a state-determined number of points to earn a highly qualified status (39 states). 

Most states allowed points to be earned retroactively for such things as successful completion of certain 
college courses (39 states), other professional development (39), years of teaching experience (37), 
receiving teaching awards or honors (25 states), and publishing articles or making presentations at 
conferences (26 states). Twenty-seven states allowed teachers to earn 45 to 50 percent of their HOUSSE 
points for a specified number of years of prior teaching experience in their subject areas; the law states 
that HOUSSE procedures can take into consideration but cannot be primarily based on the time the 
teacher has been teaching in the academic subject.^™** 

Ten states allowed teachers to demonstrate subject knowledge by choosing from a Ust of possible 
activities (i.e., a menu of options) offered by the state and by meeting the criteria for the chosen activity. 
Five states considered evidence of improved student achievement. Other state HOUSSE systems 
included performance evaluations (five states), the state’s teacher certification systems (two states), and a 
log or record of professional development activities that a teacher had taken in his or her content area 
(one state). 

B. Teachers’ Highly Qualified Status 

The large majority of teachers across the country have been designated as highly qualified 
under NCLB. According to state-reported data for 50 states and the District of Columbia, 94 percent 
of elementary and secondary classes were taught by highly qualified teachers in 2006—07, up from 87 
percent in 2003—04. Most states (42) reported that the large majority (90 percent or more) of classes 
were taught by highly qualified teachers; only two states and the District of Columbia reported that this 
percentage was below 75 percent.'^ 
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Compared with the state-reported data, teacher reports provided somewhat lower estimates of 
the percentage of teachers who were highly qualified; however, teachers sometimes indicated 
they did not know their highly qualified status. For example, 84 percent of regular classroom 
teachers^ reported in 2006—07 that they were considered highly qualified under ATCLB, up from 74 
percent in 2004—05. The percentage of teachers who did not know their status declined from 23 percent 
to 14 percent. Only 2 percent of these teachers said in 2006—07 that they were not highly qualified, 
down slightly from 4 percent in 2004—05 (see Exhibit 34). 

High school teachers were the least likely to report that they were highly qualified; 78 percent of high 
school English and mathematics teachers reported that they were highly qualified, compared with 87 
percent of middle school English and mathematics teachers. High school teachers were also less likely to 
know their highly qualified status: 19 percent of high school English and mathematics teachers reported 
that they did not know their highly qualified status, compared with 10 percent of middle school English 
and mathematics teachers.™ 



Special education teachers 
were less likely than general 
education teachers to report 
that they were highly 
qualified, but the gap 
between general education 
teachers and special 
education teachers 
narrowed from 2004—05 to 
2006-07. In 2006-07, 72 
percent of special education 
teachers reported that they 
were highly qualified, up from 
52 percent in 2004—05, and 
the difference between special 
education teachers and general 
education teachers declined 
from a 22 percentage point 
difference in 2004—05 to 12 
percentage points in 2006—07. 

However, special education 
teachers of English and 
mathematics at the high 
school level were much less 
likely to report that they were 
highly qualified than were 
their special education colleagues at the middle school level or their general education colleagues at the 
high school level. Only 56 percent of high school English and mathematics special education teachers 
reported that they were highly qualified, compared with 7 1 percent of middle school English and 
mathematics special education teachers.™* 

Among teachers who said they were highly qualified under NCLB in 2006—07, those in high- 
poverty schools had less experience and were less likely to have a degree in the subject that they 
teach compared with their peers in low-poverty schools. For example, in 2006—07, 14 percent of 
highly qualified teachers in high-poverty schools had fewer than three years of teaching experience. 



Exhibit 34 

Percentage of Teachers Reporting That They Are Considered 
Highiy Quaiified Under NCLB, 2004-05 and 2006-07 
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General Education Teachers 




2004-05 2006-07 

Special Education Teachers 



Exhibit reads: The percentage of general education teachers 
reporting that they were considered highly qualified under JVCLh 
rose from 74 percent in 2004—05 to 84 percent in 2006—07. 

Source: National Longitudinal Study of NCLB, Teacher Survey (»=7,473 to 7,674 
general education teachers and 1,137 to 1,158 special education teachers; see Appendix 
Exhibit B-14). 
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compared with 8 percent of highly qualified teachers in low-poverty schools. Similarly, highly qualified 
secondary mathematics and English teachers in high-poverty schools were less likely to have a degree in 
the field that they teach. Specifically, mathematics teachers with a major in mathematics accounted for 
32 percent of highly qualified mathematics teachers in high-poverty schools and 50 percent in low- 
poverty schools, while English teachers with a major in English accounted for 43 percent of highly 
qualified English teachers in high-poverty schools and 63 percent in low-poverty schools.^'" 

C. Professional Development 

Research indicates that professional development that places a strong emphasis on academic 
content, and on how students learn specific content, is associated with gains in student 
achievement.” Research also indicates that teachers reported that professional development enhanced 
their knowledge and skills when it was sustained and intensive; connected to state standards and to 
teachers’ goals or other learning experiences; involved teams of teachers from the same grade levels, 
departments, or schools; and allowed teachers to observe and practice the skills and techniques being 
introduced or to actively engage in conversations about teaching and learning.”* 

Although there is no hard evidence on the minimum number of contact hours or duration necessary for 
professional development to have an impact on teaching practice and student achievement, researchers 
argue that professional development is more likely to have an impact if it involves many contact hours 
over a long time period.”** For example, in the Closing the Reading Gap study of reading interventions, 
teachers participating in the interventions received an average of 70 hours of training in the intervention 
over the course of the school year, including an initial week of intensive introduction to the program, an 
additional 24 hours during a seven-week period at the beginning of the year when teachers practiced 
their assigned method with students in their schools, and about 14 hours of supervision during the 
intervention phase. These interventions were found to be effective in raising reading achievement for 
third-grade students (but not fifth-graders); it is not known whether the interventions would have been 
equally effective with a smaller amount of teacher training.”*** 

At the elementary level, teachers reported more hours of professional development in reading 
and mathematics than on other professional development topics. Over the course of the 2005—06 
school year and summer, elementary teachers reported participating in an average of 20 hours of 
professional development on instructional strategies for teaching reading, 10 hours on instructional 
strategies for mathematics, and six hours on other academic subjects. These teachers also reported 
spending 12 hours on in-depth study of topics in reading and six hours on in-depth study of topics in 
mathematics, but it is not known to what extent teachers may have reported some of the same 
professional development experiences as both “instructional strategies” and “in-depth study.” 
Elementary teachers also reported spending eight hours on professional development on analy 2 ing 
student achievement data, eight hours on preparing students to take the annual state assessment, and 
seven hours on use of technology. 

Across all topics and types of professional development, both formal and informal, elementary teachers 
reported participating for a total of 97 hours during the 2005—06 school year and summer; middle and 
high school teachers reported a sUghdy larger number of professional development hours (1 06 and 1 02 
hours, respectively). 

Although most teachers reported that they participated in some professional development that 
focused on instructional strategies for teaching reading or mathematics, relatively few 
participated for an extended period of time. For example, 79 percent of elementary teachers 
participated in at least one hour of professional development focused on instructional strategies for 
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teaching mathematics during the 2005—06 school year and summer, but only 44 percent participated for 
six or more hours and only 1 1 percent participated for more than 24 hours. In reading, 92 percent 
of elementary teachers participated in at least one hour of professional development focused on 
instructional strategies for reading, 67 percent participated for six or more hours, and 26 percent 
participated for more than 24 hours (see Exhibit 35).™ 



Exhibit 35 

Teacher Participation in Professional Development Focused on 
Instructional Strategies and In-Depth Study of Topics in Reading and Mathematics, 2005-06 



Elementary Teachers 




Reading Math 

Instructional Strategies 



Reading Math 

In-Depth Study 



Secondary English and Mathematics Teachers 




English Math 

Instructional Strategies 









29% 


19% 






38% 




English Math 

In-Depth Study 



Exhibit reads: In 2005—06, 26 percent of elementary teachers reported participating in more than 24 
hours of professional development focused on instructional strategies for teaching reading. 

Source: National Longitudinal Study of ATCLB, Teacher Survey (;;=3,980 to 4,047 elementary teachers, 1,776 to 1,790 secondary 
English teachers, and 1,694 to 1,699 secondary mathematics teachers; see Appendix Exhibits B-15 and B-16). 



Teachers were less likely to report that they participated in professional development focused on 
in-depth study of reading and mathematics than they were in training in instructional strategies. 

Only 14 percent of elementary teachers and 16 percent of secondary English teachers participated in in- 
depth study of topics in reading or English for more than 24 hours during the 2005—06 school year and 
summer; fewer than half participated for six or more hours. In addition, nearly half of all general 
elementary teachers (47 percent) and over one-third of secondary mathematics teachers (38 percent) 
did not participate in any professional development focused on the in-depth study of mathematics.'^’^ 

Both elementary and secondary teachers reported participating in more hours of professional 
development in reading and mathematics in 2005—06 compared with 2003—04. For example, the 
percentage of elementary teachers who participated in six or more hours of professional development 
focused on instructional strategies for teaching reading rose from 59 percent in 2003—04 to 68 percent in 
2005—06, and the percentage who participated for more than 24 hours rose from 20 percent to 26 
percent (see Exhibit 36). Similarly, the percentage of secondary mathematics teachers who participated 
in more than 24 hours of professional development focused on instructional strategies for mathematics 
increased from 16 percent to 22 percent. Teachers were less likely in 2005—06 to report that they did 
not participate in any professional development in mathematics (21 percent of elementary teachers and 
1 3 percent of secondary mathematics teachers, down from 29 percent and 23 percent, respectively, in 
2003-04).™ 
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Exhibit 36 

Change in Teacher Participation in Professional Development Focused on 
Instructional Strategies for Reading and Mathematics, 2003-04 to 2005-06 
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Exhibit reads: In 2005—06, 26 percent of elementary teachers reported participating in more than 24 
hours of professional development focused on instructional strategies for teaching reading, compared 
with 20 percent in 2003—04. 

Source: National Longitudinal Study of NCLB, Teacher Survey {n=3y994 to 4,047 elementary teachers, 1,740 to 1,790 secondary 
English teachers, and 1,580 to 1,699 secondary mathematics teachers; see Appendix Exhibit B-15). 



Teachers in schools identified for improvement were often more likely to report that they 
participated in professional development focused on reading and mathematics than were 
teachers in non-identified schools. For example, elementary teachers in identified schools were more 
likely than teachers in non-identified schools to report receiving at least six hours of professional 
development in instructional strategies for reading (77 percent vs. 67 percent) and mathematics (52 percent 
vs. 43 percent). Statistically significant differences between teachers in identified and non-identified schools 
were also found for high school teachers in instructional strategies for reading and math and for elementary 
and middle school teachers’ in-depth study of reading and mathematics. 
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ENDNOTES 



I. Introduction 

‘ Section 1501 of the Hkmentary and Secondary Education Act, as reauthorked by the No Child Eeft Behind Act. Reports from 
previous National Assessments of Title I include: 1) U.S. Department of Education, Office of the Under Secretary, 
Planning and Evaluation Service (2001), High Standards for All Students: A Report from the National Assessment of Title I on 
Progress and Challenges Since the 1994 Rjiauthori-gation-, 2) U.S. Department of Education, Office of the Under Secretary, 
Planning and Evaluation Service (1 999), Promising Results, Continuing Challenges: The Final Report of the National Assessment of 
Title I; 3) U.S. Department of Education, Office of Policy and Planning, Planning and Evaluation Service (1993), 
Reinventing Chapter 1 : The Current Chapter 1 Program and New Directions. 

“ U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and 
Regional Assistance (2007). National Assessment of Title I Final Report: Volume I: Implementation of Title I, by Stephanie 
Stullich, Elkabeth Eisner, and Joseph McCrary. Washington, D.C.: Author. 

“ The National Longitudinal Study of No Child Eeft Behind was conducted by the RAND Corporation in collaboration 
with the American Institutes for Research and the National Opinion Research Center. Response rates for 2006—07 were 
99 percent for the school district survey, 94 percent for the principal survey, 86 percent for the teacher surveys, 91 
percent for the Title I paraprofessional survey, 63 percent for the parent survey, and 79 percent for the supplemental 
service provider survey. 

The Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind was conducted 
by the American Institutes for Research in collaboration with the Council of Chief State School Officers and REDA 
International. Interviews were completed for all 50 states, the District of Columbia, and Puerto Rico. 

Eligibility for the free and reduced-price lunch program included students who live in households with income up to 
185 percent of the federal poverty threshold. U.S. Department of Agriculture (2004). Child nutrition programs: Income 
eligibility guidelines. Federal Register, 69(f>F), 16226—16229. Retrieved April 12, 2006, from 
www.fns.usda.gov/ end/ Governance/ notices/iegs/IEGs04-05.pdf. 

The two different definitions of “low-poverty schools” reflect different practices used in different data sources. Title I 
program evaluations conducted by the U.S. Department of Education have historically defined “low-poverty schools” as 
schools with fewer than 35 percent of their students eligible for free and reduced-price lunches; this group included 14 
percent of all Title I schools in 2004-05. For NAEP, schools were asked to report whether their percentage of free and 
reduced-price lunch eligible students was within one of four specified ranges, including the 0—25 percent group; thus, the 
NAEP data cannot be tabulated using different poverty thresholds. 

™ For simplicity, the term “reading” is used throughout this report to refer to the set of subjects that may be variously 
known as reading, English, or language arts. 

II. Trends in Student Achievement 

™‘ U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and 
Regional Assistance (2006). National Assessment of Title I Interim Raport, Volume I: Implementation of Title I, by Stephanie 
Stullich, Eli 2 abeth Eisner, Joseph McCrary, and Collette Roney. Washington, D.C.: Author. 

U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and 
Regional Assistance (2007). National Assessment of Title I Final Report, Volume I: Implementation of Title I, by Stephanie 
Stullich, Elkabeth Eisner, and Joseph McCrary. Washington, D.C.: Author. 

Similar analyses in previous reports conducted under the National Assessment of Title I used a combination of data 
from three elementary grades (grades 3, 4, and 5) and three middle school grades (grades 6, 7, and 8), because some 
states did not have fourth- and eighth-grade reading and mathematics assessments in all three years used in those 
analyses. The current report, however, was able to use assessment data for a single elementary grade (grade 4) and a 
single middle school grade (grade 8), because by the 2004-05 school year, a greater number of states had begun 
administering reading and mathematics assessments in grades 4 and 8 as they moved toward meeting the NCEB 
requirement to administer reading and mathematics assessments in each grade from 3 through 8 by 2005-06. 

“ A report conducted by the Thomas B. Fordham Institute and the Northwest Evaluation Association found, “Eighth- 
grade tests are sharply harder to pass in most states than those in earlier grades (even after taking into account obvious 
differences in subject-matter complexity and children’s academic development).” See John Cronin, Michael Dahlin, 
Deborah Adkins, and G. Gage Kingsbury (2007), The Prof deny Illusion, Washington, D.C.: Thomas B. Fordham 
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Institute. 

As discussed on page 4, there are a number of validity issues involved with examining patterns in state assessment 
results, including differences across states and over time in the content and difficulty of state assessments. The National 
Assessment of Educational Progress provides a superior instrument for examining changes in achievement over time 
and progress in closing achievement gaps, because it is consistent across states and over time, in contrast with state 
assessments, which do not provide a consistent measure across states and which frequently provide limited trend data 
within states due to changes in assessment content, proficiency standards, inclusion policies, and other aspects of the 
state assessment system. At the same time, the NAEP is not aligned with individual state content and achievement 
standards, and state assessments represent the primary criterion that the Title I legislation applies to measure school 
success. Consequently, this report examines achievement gains and changes in achievement gaps using both NAEP and 
state assessments. 

The most recent NAEP data for reading were published in Jihyun Lee, Wendy S. Grigg, and Patricia L. Donahue 
(2007), The Nation’s Teport Card: Reading 2007 (NCES 2007-496), Washington, D.C.: U.S. Department of Education, 
National Center for Education Statistics. The most recent NAEP data for mathematics were published in Jihyun Lee, 
Wendy S. Grigg, and Gloria S. Dion (2007), The Nation’s Report Card: Mathematics 2007 (NCES 2007-494), Washington, 
D.C.: U.S. Department of Education, National Center for Education Statistics. The most recent NAEP data for science 
were published in Wendy S. Grigg, Mary A. Lauko, and Debra M. Brockway (2006), The Nation’s Report Card: Science 2005 
(NCES 2007-466), Washington, D.C.: U.S. Department of Education, National Center for Education Statistics. 

^ State participation in NAEP was not required prior to NCLB and, as a result, NAEP results for years prior to 2003 
are based on a subset of the states. For example, for the fourth-grade NAEP reading assessment, 39 states participated 
in 1998 and 44 states participated in 2002, compared with 50 states and the District of Columbia in 2003. Also, NAEP 
changed its approach to testing accommodations for students with disabilities and LEP students during the period 
examined in this report. Before 1996, no testing accommodations were provided to such students participating in 
NAEP assessments. Beginning in 1996 for the mathematics assessment and 1998 for the reading assessment, the Main 
NAEP was administered to two reporting samples — accommodations permitted and accommodations not permitted. 
Beginning in 2002 for reading and 2003 for mathematics, NAEP administered the Main NAEP test with 
accommodations permitted as its only administration procedure. For this National Assessment of Title I report. Main 
NAEP results are reported with no accommodations up through 1994 and with accommodations permitted thereafter. 

For the NAEP fourth-grade reading assessment, the percentages of assessed students who were in the three largest 
race and ethnicity categories were: 

White (72 percent in 1992 and 56 percent in 2007); 

Hispanic (7 percent in 1992 and 20 percent in 2007); and 
Black (18 percent in 1992 and 17 percent in 2007). 

See Table A-6 in Jihyun Lee, Wendy S. Grigg, and Patricia L. Donahue (2007), The Nation’s Report Card: Reading 2007 
(NCES 2007-496), Washington, D.C.: U.S. Department of Education, National Center for Education Statistics. 

III. Implementation of State Assessment and Accountability Systems 

XVI Pqj. State review, the Department convened a panel of about three peer reviewers who were selected from a pool 
of experts with assessment-related experience in the areas of psychometrics, test administration, special education, and 
language assessment (mostly active or retired state or district assessment directors). Reviews of states’ initial submissions 
of evidence began during the 2004—05 school year, and each state submitted documentation to the Department to 
demonstrate that their statewide assessment systems met the requirements outlined in Department guidance in seven 
areas: academic content standards, academic achievement standards, full statewide assessment system, technical quality, 
alignment, inclusion, and reporting. The panel members individually reviewed the state’s evidence submission and 
independently evaluated the state’s evidence using the NCLB peer review guidance. The peer reviewers then met as a 
team to discuss the evidence, provide feedback on the state’s evidence submission, and prepare a report for each state 
that summari 2 ed the feedback. Department staff facilitated the team meetings. Based on the peer review comments. 
Department staff prepared a memorandum with a recommended approval status for each state, which was then 
reviewed by the assistant secretary for elementary and secondary education and by policy and program staff to make a 
final decision. Following each review, states that did not adequately address all requirements were sent a letter outlining 
the additional evidence they needed to submit to meet requirements. Additional reviews were scheduled as needed and 
are continuing. 

U.S. Department of Education, Office of Elementary and Secondary Education, Decision Letters on State Final 
Assessment Systems Under Title I of ESEA as amended by the No Child Left Behind Act of 2001. 
www.ed.gov/admins/lead/account/nclbfinalassess/index.html, accessed Jan. 8, 2009. 



52 




xvm 'pgjj states have approved science assessments in three grade spans: Ari 2 ona, Delaware, Indiana, Kentucky, New 
York, Ohio, Tennessee, Utah, Washington, and Wisconsin. West Virginia has received approval for its general science 
assessment but not its alternate science assessment. 

U.S. Department of Education, Office of Elementary and Secondary Education, Decision Letters on State Final 
Assessment Systems Under Title I of ESEA as amended by the No Child Eeft Behind Act of 2001 . 
www.ed.gov/admins/lead/account/nclbfinalassess/index.html, accessed Jan. 8, 2009. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

™ Schools that were identified for improvement under the previous law (L4SA) were required to begin NCEB 
improvement interventions in 2002-03. The 2002-03 Consolidated State Performance Report (CSPR) directed states to 
provide a list of Title I schools identified for improvement for the 2003-04 school year based on state assessment data 
from the 2002-03 school year. For previous years, the directions were less specific and states may have followed 
different practices for the defining the year for which they reported data. In this report, the number of identified 
schools from the 2002—03 CSPR is reported as “schools identified for the 2003—04 school year.” Prior to that year, this 
report uses the CSPR year as the data year; for example, the number of identified schools from the 2001—02 CSPR is 
reported as the number identified for 2001-02. 

The total numbers of identified schools in each year differ from totals in summary reports on the State Consolidated 
Performance Reports because the CSPR reports also include data reported by the Bureau of Indian Affairs (in addition 
to data reported by the states). The number of identified Title I schools for 2004-05 differ from the official data in the 
State Consolidated Performance Reports because Michigan and Oregon indicated that their CSPR submissions included 
non— Title I schools. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind, based on data from 
the Consolidated State Performance Reports. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

™ Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 
xxvii 15 (Jistricts with the most Title I schools in corrective action status accounted for 21 percent of all Title I 
schools in corrective action. Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft 
Behind. 

xxvm Another 503 identified schools were of other types. The sum across levels is somewhat less than the total number 
of identified schools reported earlier due to some missing data on school grade level. Study of State Implementation of 
Accountability and Teacher Quality Under No Child Eeft Behind. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

Under NCEB, schools and districts are held accountable for AYP targets only when they have at least a minimum 
number of students in the subgroup categories. Because district-level AYP calculations include students from all 
schools, districts may meet the minimum subgroup si 2 es for certain groups of students even if none of their schools do. 
If such groups do not make AYP at the district level while not counted at the school level, the result will be that districts 
may be identified for improvement when none of their schools are. Study of State Implementation of Accountability 
and Teacher Quality Under No Child Eeft Behind. 

™ Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

xxxii Looking at a consistent set of 29 states for which data were available for both 2003-04 and 2004-05, the percentage 

of schools missing AYP for the all students group declined to 29 percent in 2004—05 from 35 percent in 2003—04, while 

fewer schools missed AYP solely due to the achievement of a single subgroup (21 percent vs. 23 percent), test 

participation rates (4 percent vs. 7 percent), or the other academic indicator (4 percent vs. 7 percent). A larger 

percentage of schools missed AYP for the achievement of two or more subgroups in 2004—05 (27 percent vs. 17 

percent). Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

xxxiii Data for calculating percentages for limited English proficient students and students with disabilities were not 

available. Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

xxxiv Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 

XXXV 'Dais analysis builds on the work of John Novak and Bruce Fuller (2003), Penaliefng Diverse Schools? Policy Brief 03-04, 
Berkeley, Calif: Policy Analysis for California Education. State and Eocal Implementation of the No Child Eeft Behind Act, Vol 
III; Accountability 

xxxvi Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 
xxxvii National Longitudinal Study of No Child Eeft Behind. 
xxxviii National Longitudinal Study of No Child Eeft Behind. 
xxxix National Longitudinal Study of No Child Eeft Behind. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Eeft Behind. 
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National Longitudinal Study of No Child Neft Behind. 

National Longitudinal Study of No Child Ceft Behind. 

xim Pqj. example, teachers In schools Identified for improvement were more likely to report reducing instructional time 
for art and music than were teachers in non-identified schools (11 percent vs. 6 percent), but for other subjects there 
were no significant differences between identified and non-identified schools. National Longitudinal Study of No Child 
Neft Behind. 

Beth A. Morton and Ben Dalton (2007), Stats in Brief: Changes in Instructional Hours in Four Subjects by Fublic School 
Teachers of Grades 1 Through 4 (NCES 2007-305). Washington, D.C.: U.S. Department of Education, National Center for 
Education Statistics. 

Center on Education Policy (2008), Instructional Time in Flementary Schools: A CloserTook at Changes for Specific Subjects, 
Washington, D.C.: Author. 

National Longitudinal Study of No Child Teft Behind. 
xivii National Longitudinal Study of No Child Teft Behind. 
xiviii National Longitudinal Study of No Child Teft Behind. 

National Longitudinal Study of No Child Teft Behind. 

' Study of State Implementation of Accountability and Teacher Quality Under No Child Teft Behind. 

National Longitudinal Study of No Child Teft Behind. 

The states that reported using growth measures in non-NCTB accountability systems in fall 2006 and also have been 
approved for the growth model pilot program are: Ari 2 ona, Delaware, Florida, Michigan, Missouri, North Carolina, and 
Ohio. Additional states that reported using growth measures in non-NCTB accountability systems are: California, 
Colorado, Idaho, Indiana, Kentucky, South Carolina, Texas, and Utah. 

In the Peterson (2006) study, 66 percent of Florida schools received an A or B under the state’s “A-I-” accountability 
system but 77 percent did not make AYP under NCTB, indicating that accountability designations under the state’s A-l- 
system were often inconsistent with NCTB accountability designations. We examined this issue for the 45 Florida 
schools in the NLS-iVCLB sample for which we had principal responses to the survey question about NCTB and state 
accountability designations. Thirteen (29 percent) of these sample schools reported conflicting accountability 
designations; for 10 out of 29 schools identified for improvement under NCTB (according to principal reports), the 
principal said the school was considered high-performing under the state accountability system, and three out of 1 6 
principals of non-identified schools said they were considered low-performing under the state system. Looking at school 
accountability designations as reported by the state of Florida yielded similar findings. Among the 39 sample schools in 
Florida that were identified for improvement, a majority (21) received a grade of C or D under the state’s A-l- 
accountability system, but 7 received an A and 9 received a B. For the 18 Florida schools not identified for 
improvement under NCTB, 13 received an A, 2 received a B, and 3 received a C or D. So, schools that were identified 
under NCTB tend to get lower ratings under the state’s A-l- system compared with schools that were not identified 
under NCTB, but there was a si 2 eable amount of inconsistency between the two accountability systems. However, 
across the entire NLS-IVCLB sample, there were few cases where principals reported receiving conflicting designations. 

National Longitudinal Study of No Child Teft Behind. 

IV. Title I School Choice and Supplemental Educational Services 

''' As of 2007-08, 19 school districts in four states (Alaska, Indiana, North Carolina, and Virginia) are participating in a 
pilot project allowing them to switch the order of the two Title I choice options, i.e., to offer supplemental services in 
schools in Year 1 of improvement status and defer offering school choice until a school is in Year 2 of improvement 
status. 

U.S. Department of Education, ED Facts Consolidated State Performance Reports. 

U.S. Department of Education, EDFacts Consolidated State Performance Reports. 

'™‘ U.S. Department of Education, EDFacts Consolidated State Performance Reports. 

National Longitudinal Study of No Child Teft Behind. 

U.S. Department of Education, EDFacts Consolidated State Performance Reports. 

National Longitudinal Study of No Child Teft Behind. 

National Longitudinal Study of No Child Teft Behind. 
ixm National Longitudinal Study of No Child Teft Behind. 

ixiv Policy and Program Studies Service reviews of State Education Agency Web sites, conducted by Westat for May 2003 
through May 2005 and conducted by the Urban Institute for May 2006 and May 2007. 

National Longitudinal Study of No Child Teft Behind. 

National Longitudinal Study of No Child Teft Behind. 
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ixvii National Longitudinal Study of No Child Ijift Behind. 
kvm National Longitudinal Study of No Child Neft Behind. 
ixix National Longitudinal Study of No Child Ceft Behind. 

National Longitudinal Study of No Child Neft Behind. 
ixxi National Longitudinal Study of No Child Ceft Behind. 
ixxii National Longitudinal Study of No Child Ceft Behind. 
ixxiii National Longitudinal Study of No Child Neft Behind. 
ixxiv National Longitudinal Study of No Child Neft Behind. 
ixxv National Longitudinal Study of No Child Ceft Behind. 
ixxvi National Longitudinal Study of No Child Neft Behind. 

ixxvii Policy and Program Studies Service, review of State Education Agency Web sites. 

ixxviii National Longitudinal Study of No Child Ceft Behind. This finding Is consistent with other research. Case studies in 
nine districts estimated an average of 60 hours of instruction per year in those districts in 2003—04 (Leslie M. Anderson 
and Katrina G. Laguarda, 2005, Case Studies of Supplemental Services Under the No Child Ueft Behind Act: Findings From 2003- 
04, Washington, D.C.: U.S. Department of Education, Office of Planning, Evaluation and Policy Development, Policy 
and Program Studies Service). Similarly, another survey of 216 supplemental service providers found that one-quarter of 
respondents offered 31-45 instructional hours per school year, one-quarter offered 46-60 hours, and one-quarter 
offered more than 60 hours (American Institutes for Research and Education Industry Association, 2005, The Promise and 
Challenge of SupplementalFducational Services: The Providers’ Perspective). 
ixxix National Longitudinal Study of No Child Teft Behind. 
ixxx National Longitudinal Study of No Child Teft Behind. 
ixxxi National Longitudinal Study of No Child Teft Behind. 

ixxxii Pq). jjjore information on the methodology for this study, see U.S. Department of Education, Office of Planning, 

Evaluation and Policy Development, Policy and Program Studies Service (2007), State and Tocal Implementation of the No 

Child Left Behind Act.’ Volume I — Title I School Choice, SupplementalFducational Services, and Student Achievement, by Ron 

Zimmer, Brian GiU, Paul Razquin, Kevin Booker, and J.R. Lockwood III, Washington, DC: Author. 

ixxxm Pqj. jjjore information on the interpretation of effect sizes found in this study, see Georges Vernez and Ron 

Zimmer (2007), Interpreting the Effects of Title I SupplementalFducational Services, available at 

www.ed.gov/ rschstat/ eval/ choice/implementation/ achievementanalysis-sizes.doc. 

ixxxiv Study of State Implementation of Accountability and Teacher Quality Under No Child Teft Behind. 

ixxxv Study of State Implementation of Accountability and Teacher Quality Under No Child Teft Behind. 

ixxxvi Study of State Implementation of Accountability and Teacher Quality Under No Child Teft Behind. 

ixxxvii National Longitudinal Study of No Child Teft Behind. 

ixxxvm National Longitudinal Study of No Child Teft Behind. 

V. Teacher Quality and Professional Development 

ixxxix nCLB specifies the core academic subjects to be English, reading or language arts, mathematics, science, foreign 
languages, civics and government, economics, arts, history, and geography. Section 9101(11) of the No Child Teft Behind 
Act. 

Dan Goldhaber and Dominic Brewer (2000), “Does teacher certification matter? High school certification status and 
student achievement,” Educational Evaluation and Policy Analysis, 22(2), 129-145; David H. Monk and Jennifer A. King 
(1994), “Multilevel teacher resource effects on pupil performance in secondary mathematics and science: The role of 
teacher subject-matter preparation,” in R.G. Ehrenberg, Contemporay poliy issues: Choices and consequences in education (pp. 
29-58), Ithaca, N.Y.: ILR Press; Brian Rowan, F.S. Chiang, and Robert). Miller (1997), “Using research on employees’ 
performance to study the effects of teachers on students’ achievement,”^)?^/)?^ of Education, 70, 256-284. 

™ Brian Rowan, Richard Correnti, and Robert). Miller (2002), “What large-scale, survey research teUs us about teacher 
effects on student achievement: Insights from the Prospects study of elementary schools,” Teachers College Bxcord, 104(8), 
1525-1567. 

Charles Clotfelter, Helen F. Ladd, and Jacob Vigdor, “Teacher Quality and Minority Achievement Gaps,” Working 
Paper Series, October 2004, Terry Sanford Institute of Public Policy at Duke University. Dan Goldhaber, “Teacher 
Licensure Tests and Student Achievement: Is Teacher Testing An Effective Policy?” University of Washington and the 
Urban Institute, Draft paper, March 29, 2005. Dan Goldhaber, “Everyone’s Doing It, But What Does Teacher Testing 
TeU Us About Teacher Effectiveness?” University of Washington and the Urban Institute, Draft Paper, April 2006. 

““ Dan Goldhaber, “Everyone’s Doing It, But What Does Teacher Testing TeU Us About Teacher Effectiveness?” 
University of Washington and the Urban Institute, Draft Paper, April 2006. 
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Study of State Implementation of Accountability and Teacher Quality Under No Child Neft Behind. 
xcv Personal communication on Nov. 29, 2005 with Rick Tannenbaum, director of assessment design and scoring, 
Educational Testing Service. 

Educational Testing Service, unpublished data provided on Sept. 7, 2007. The national median scores were based on 
scores of aU individuals who took these tests from Oct. 1, 2004, to July 31, 2007. 

U.S. Department of Education (Sept. 5, 2006) Letter to Chief State School Officers. Available at: 
http:/ / www.ed.gov/ policy/ elsec/ guid/ secletter/ 060905.html (retrieved February 2007). 
xcvm Section 9101 (23) (C) of the No Child Ceft Behind Act. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Neft Behind. 

Study of State Implementation of Accountability and Teacher Quality Under No Child Ceft Behind. 

“ Teacher survey data used in this report are from the National Longitudinal Study of NCLB, which is not representative 
of aU teachers; the study sampled elementary classroom teachers, secondary English teachers, and secondary math 
teachers in a nationally representative sample of schools. For simplicity, we use the term “teachers” to refer to these 
data. The study also surveyed a sample of special education teachers (both elementary and secondary), and data for 
these teachers are reported separately. 

National Longitudinal Study of No Child Ceft Behind. 

™ Similarly, 38 percent of middle school English teachers reported they had a major in English, compared with 81 
percent of high school English teachers. Marilyn Seastrom, Kerry Gruber, Robin Henke, Daniel McGrath, and 
Benjamin Cohen (2004), Qualifications ofi the Public School Teacher Workforce: Prevalence of Out-of-Field Teaching: 1987-88 to 
1999-2000 (NCES 2002-603), Washington, D.C.: U.S. Department of Education, National Center for Education 
Statistics. The sample for this survey included 56,354 teachers, with a response rate of 83 percent. More information on 
the methodology for this study can be found at http:/ / nces.ed.gov/ surveys/SASS/ methods9900.asp. 

National Longitudinal Study of No Child Feft Behind. 

Mary Kennedy (1998). Research Monograph No. 13: Form and Substance in Inservice Teacher Education. Madison: National 
Institute for Science Education, University of Wisconsin. David K. Cohen, Milbrey W. McLaughlin, and Heather C. Hill 
(1998). Instructional Policy and Classroom Performance: The Mathematics Reform in California (RR-39). Philadelphia: Consortium 
for Policy Research in Education. 

™ Michael S. Garet, Beatrice F. Birman, Andrew C. Porter, Laura Desimone, Rebecca Herman, and Kwang Suk Yoon 
(1999). Designing Effective Professional Development: Lessons From the Eisenhower Professional Development Program. Washington, 
D.C.: U.S. Department of Education, Office of the Under Secretary, Planning and Evaluation Service. 

™‘ Michael S. Garet, Beatrice F. Birman, Andrew C. Porter, Laura Desimone, Rebecca Herman, and Kwang Suk Yoon 
(1999). Designing Effective Professional Development: Lessons From the Eisenhower Professional Development Program. Washington, 
D.C.: U.S. Department of Education, Office of the Under Secretary, Planning and Evaluation Service. 

™“ Joseph Torgeson, Allen Schirm, Laura Castner, Sonya Varfivarian, Wendy Mansfield, David Myers, Fran Stancavage, 
Donna Durno, Rosanne Javorsky, and Cinthia Haan (2007). National Assessment of Title I Final Report, Volume II: Closing 
the Reading Gap, Findings From a Ruindomfed Trial of FourReadingInterventions for StrivingReaders. Washington, D.C.: U.S. 
Department of Education, Institute of Education Sciences. 

“ National Longitudinal Study of No Child Left Behind. 

“ National Longitudinal Study of No Child Left Behind. 

™ National Longitudinal Study of No Child Left Behind. 

National Longitudinal Study of No Child Left Behind. 
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APPENDIX A: SUPPLEMENTAL EXHIBITS 



Exhibit A-1 

Percentage of Eighth-Grade Students Achieving At or Above the Proficient Levei 
on NAEP and State Assessments in Mathematics, 2007 
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Sources: Consolidated State Performance Reports; National Center for Education Statistics, Main NAEP. 
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Exhibit A-2 

Proportion of Fourth-Grade Students Performing At or Above Their State’s Proficient Levei 
in Reading in 2006-07, and Change From 2004-05, for Various Student Subgroups 




1 All Students 


1 lep 


1 Migrant 


1 Disabilities I 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


85 


2 


67 


-2 


72 


3 


46 


3 


Alaska 


80 


3 


53 


4 


63 


13 


48 


2 


Arizona 


65 


2 


21 


1 


39 


0 


34 


1 


Arkansas 


58 


7 


36 


4 


39 


-3 


36 


26 


California 


52 


4 


35 


6 


26 


4 


27 


5 


Colorado 


86 


-1 


66 


-2 


62 


-5 


54 


-1 


Florida 


69 


-3 


47 


-5 


43 


-5 


42 


-2 


Indiana 


75 


2 


58 


12 


41 


2 


48 


8 


Iowa 


80 


0 


52 


5 


57 


-38 


42 


2 


Louisiana 


70 


2 


67 


0 


60 


6 


36 


-1 


Maryland 


86 


5 


69 


15 






67 


10 


Massachusetts 


56 


6 


17 


3 






19 


1 


Mississippi 


90 


1 


83 


5 


79 


2 


59 


-3 


Montana 


80 


5 


38 


10 






48 


7 


New Jersey 


79 


-2 


37 


-9 






49 


1 


New Mexico 


55 


3 


29 


-3 






24 


4 


North Carolina 


85 


3 


73 


17 


75 


10 


59 


6 


North Dakota 


81 


5 


50 


18 


70 


24 


71 


14 


Oklahoma 


88 


5 


75 


13 


66 


-6 






South Carolina 


53 


18 


38 


21 


27 


10 


21 


7 


South Dakota 


88 


0 


63 


31 


78 


-9 


71 


-10 


Tennessee 


88 


1 


53 


6 


61 


19 


69 


7 


Texas 


83 


4 


70 


1 


69 


5 


76 


5 


Utah 


78 


0 


55 


7 


52 


7 


47 


0 


Washington 


78 


-2 


38 


-8 


55 


4 


57 


13 


West Virginia 


83 


1 


67 


-13 










Wisconsin 


82 


1 


55 


1 


40 


-10 


52 


6 


Median 


80 


2 


53 


4 


54 


1 


48 


4 


# of states with 
achievement gains 


20 out of 27 states 


20 out of 27 states 


12 out of 21 states 


1 9 out of 25 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-3 

Proportion of Fourth-Grade Students Performing At or Above Their State’s Proficient Levei 
in Mathematics in 2006-07, and Change From 2004-05, for Various Student Subgroups 




1 All Students 


1 lep 


1 Migrant 


1 Disabilities I 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


78 


4 


66 


7 


71 


10 


42 


6 


Alaska 


76 


7 


52 


7 


61 


14 


46 


6 


Arizona 


74 


5 


39 


5 


51 


-4 


43 


6 


Arkansas 


65 


15 


45 


8 


48 


7 


47 


33 


California 


57 


7 


48 


8 


41 


8 


32 


7 


Colorado 


91 


1 


80 


3 


78 


1 


66 


5 


Florida 


69 


5 


55 


6 


54 


7 


46 


6 


Georgia 


79 


3 


61 


7 


68 


9 


52 


3 


Indiana 


75 


2 


62 


8 


48 


0 


54 


6 


Iowa 


81 


0 


56 


3 


58 


-38 


50 


2 


Louisiana 


64 


0 


67 


-6 


58 


2 


36 


-2 


Maryland 


86 


10 


70 


18 






63 


14 


Massachusetts 


48 


7 


18 


4 






17 


2 


Mississippi 


81 


2 


82 


8 


77 


10 


53 


-2 


Montana 


68 


12 


32 


14 






36 


5 


New Jersey 


84 


4 


54 


3 






62 


7 


New Mexico 


46 


7 


25 


1 






22 


6 


North Dakota 


80 


0 


52 


11 


66 


9 


69 


9 


Oklahoma 


81 


6 


71 


14 


68 


1 






South Carolina 


53 


13 


43 


19 


31 


-1 


25 


9 


South Dakota 


78 


-5 


47 


21 


76 


1 


53 


-20 


Tennessee 


89 


2 


75 


6 


77 


10 


64 


9 


Texas 


85 


4 


74 


1 


75 


5 


80 


5 


Utah 


74 


-1 


54 


2 


48 


1 


46 


-2 


Washington 


59 


-2 


18 


-7 


30 


2 


32 


3 


West Virginia 


79 


4 


76 


-6 










Wisconsin 


77 


6 


60 


13 


54 


11 


53 


10 


Median 


77 


4 


55 


7 


54 


2 


47 


6 


# of states with 
achievement gains 


21 out of 27 states 


24 out of 27 states 


17 out of 21 states 


21 out of 25 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-4 

Proportion of Eighth-Grade Students Performing At or Above Their State’s Proficient Level in Reading 
in 2006-07, and Change From 2004-05, for Various Student Subgroups 




1 All Students 


1 lep 


1 Migrant 


1 Disabilities I 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


72 


3 


36 


-1 


55 


7 


36 


14 


Alaska 


79 


3 


52 


6 


58 


1 


52 


15 


Arizona 


63 


1 


11 


-5 


36 


1 


11 


-9 


Arkansas 


63 


6 


32 


6 


39 


5 


32 


25 


California 


42 


3 


18 


1 


21 


4 


18 


5 


Colorado 


87 


0 


66 


-2 


56 


-3 


66 


13 


Florida 


49 


5 


17 


4 


23 


4 


17 


-1 


Illinois 


81 


9 


51 


6 


67 


13 


51 


19 


Indiana 


68 


1 


50 


9 


29 


5 


50 


27 


Iowa 


73 


1 


31 


7 


33 


-61 


31 


4 


Louisiana 


59 


5 


51 


6 


48 


5 


51 


35 


Maryland 


69 


2 


23 


2 






23 


-8 


Mississippi 


52 


-5 


26 


-6 


36 


-14 


26 


9 


Montana 


79 


16 


28 


13 






28 


6 


Nevada 


57 


6 


9 


-3 






9 


-5 


New Jersey 


72 


0 


16 


-4 






16 


-13 


New Mexico 


56 


5 


27 


-5 






27 


12 


North Carolina 


88 


0 


66 


14 


63 


5 


66 


7 


North Dakota 


76 


4 


45 


17 






45 


6 


Oklahoma 


78 


5 


46 


6 


62 


23 








74 


11 


23 


6 


33 


8 


23 


3 


South Carolina 


35 


6 


17 


12 


4 


-15 


17 


11 


South Dakota 


78 


-1 


43 


23 


58 


2 


43 


4 


Tennessee 


92 


5 


58 


21 


57 


32 


58 


1 


Texas 


88 


5 


53 


0 


76 


10 


53 


-17 


West Virginia 


80 


0 


66 


-15 










Wisconsin 


84 


0 


56 


6 


51 


7 


56 


12 


Median 


73 


3 


36 


6 


36 


3 


32 


6 


# of states with 
achievement gains 


20 out of 27 states 


1 8 out of 27 states 


16 out of 21 states 


1 9 out of 25 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-5 

Proportion of Eighth-Grade Students Performing At or Above Their State’s Proficient Level in 
Mathematics in 2006-07, and Change From 2004-05, for Various Student Subgroups 




1 All Students 


1 lep 


1 Migrant 


1 Disabilities I 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


66 


4 


49 


1 


59 


10 


26 


4 


Alaska 


69 


7 


44 


10 


53 


6 


29 


4 


Arizona 


61 


3 


18 


-3 


39 


5 


22 


7 


Arkansas 


48 


15 


24 


9 


30 


13 


28 


25 


California 


34 


3 


19 


2 


21 


5 


13 


3 


Colorado 


76 


1 


55 


1 


48 


-3 


33 


-2 


Florida 


63 


4 


35 


1 


45 


9 


28 


3 


Georgia 


82 


13 


59 


17 


63 


14 


49 


16 


Indiana 


71 


0 


58 


8 


38 


6 


36 


5 


Iowa 


75 


1 


43 


6 


49 


-45 


31 


0 


Louisiana 


56 


0 


51 


-4 


48 


-3 


22 


1 


Maryland 


57 


5 


29 


-3 






27 


6 


Massachusetts 


54 


1 


43 


-7 


43 


-17 


12 


-3 


Mississippi 


59 


-3 


11 


-9 






16 


-11 


Montana 


53 


4 


13 


-4 






12 


1 


New Jersey 


68 


6 


26 


1 






30 


8 


New Mexico 


30 


6 


9 


0 






7 


1 


North Dakota 


67 


2 


33 


13 






44 


10 


Oklahoma 


76 


7 


56 


8 


66 


15 






Pennsylvania 


67 


5 


31 


3 


36 


6 


28 


6 


South Carolina 


28 


5 


17 


9 


11 


-8 


5 


2 


South Dakota 


72 


4 


38 


24 


48 


3 


29 


3 


Tennessee 


88 


1 


59 


-5 


72 


0 


54 


3 


Texas 


72 


10 


43 


8 


61 


16 


72 


14 


Utah 


77 


4 


41 


-1 


51 


10 


40 


9 


West Virginia 


71 


1 


63 


-13 










Wisconsin 


75 


2 


52 


10 


49 


7 


37 


7 


Median 


67 


4 


41 


1 


44 


4 


28 


3 


# of states with 
achievement gains 


24 out of 27 states 


1 7 out of 27 states 


14 out of 21 states 


21 out of 25 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-6 

Proportion of Fourth-Grade Students Performing At or Above Their State’s Proficient Level in Reading 
in 2006-07, and Change From 2004-05, for Various Racial and Ethnic Groups 




Black 


Flispanic 


White 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


76 


1 


73 


0 


90 


2 


Alaska 


76 


3 


75 


1 


89 


2 


Arizona 


55 


3 


52 


5 


80 


1 


Arkansas 


37 


7 


44 


2 


67 


7 


California 


39 


4 


38 


5 


71 


4 


Colorado 


76 


-2 


73 


-2 


93 


1 


Florida 


51 


-5 


62 


-4 


80 


-1 


Indiana 


58 


6 


58 


3 


79 


2 


Iowa 


57 


0 


62 


3 


83 


1 


Louisiana 


58 


3 


70 


0 


79 


0 


Maryland 


78 


8 


81 


8 


93 


3 


Massachusetts 


31 


4 


28 


6 


63 


7 


Mississippi 


86 


2 


87 


3 


94 


-1 


Montana 


79 


0 


72 


9 


83 


4 


New Jersey 


62 


-3 


67 


-3 


87 


-1 


New Mexico 


48 


3 


49 


4 


71 


1 


North Carolina 


76 


4 


77 


6 


92 


2 


North Dakota 


71 


7 


71 


5 


84 


5 


Oklahoma 


80 


10 


80 


8 


91 


3 


South Carolina 


37 


16 


40 


15 


66 


19 


South Dakota 


75 


0 


75 


-2 


92 


0 


Tennessee 


79 


2 


79 


8 


92 


0 


Texas 


75 


6 


78 


5 


91 


3 


Utah 


61 


0 


57 


4 


83 


0 


Washington 


66 


-3 


61 


0 


82 


-2 


West Virginia 


77 


4 


74 


1 


83 


1 


Wisconsin 


61 


1 


64 


2 


87 


1 


Median 


66 


3 


70 


3 


83 


1 


# of states with 
achievement gains 


1 9 out of 27 states 


20 out of 27 states 


1 9 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-7 

Proportion of Fourth-Grade Students Performing At or Above Their State’s Proficient Level in Mathematics 
in 2006-07, and Change From 2004-05, for Various Raciai and Ethnic Groups 




Black 


Hispanic 


White 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


67 


5 


69 


8 


85 


4 


Alaska 


68 


10 


72 


10 


84 


6 


Arizona 


63 


7 


64 


7 


86 


3 


Arkansas 


42 


14 


54 


12 


74 


16 


California 


41 


8 


47 


8 


70 


6 


Colorado 


81 


3 


83 


2 


95 


1 


Florida 


52 


7 


66 


6 


78 


3 


Georgia 


68 


4 


74 


7 


87 


2 


Indiana 


55 


3 


60 


-1 


79 


2 


Iowa 


58 


0 


64 


2 


84 


1 


Louisiana 


48 


-1 


66 


-4 


78 


0 


Maryland 


77 


15 


81 


12 


93 


6 


Massachusetts 


22 


5 


24 


8 


54 


8 


Mississippi 


73 


4 


83 


3 


90 


1 


Montana 


55 


10 


58 


10 


71 


11 


New Jersey 


67 


7 


74 


4 


91 


3 


New Mexico 


38 


8 


40 


7 


62 


6 


North Dakota 


63 


7 


72 


3 


84 


2 


Oklahoma 


67 


13 


74 


8 


85 


4 


South Carolina 


33 


11 


42 


12 


67 


14 


South Dakota 


58 


-1 


59 


-3 


83 


-5 


Tennessee 


81 


5 


87 


7 


93 


2 


Texas 


76 


7 


81 


5 


92 


2 


Utah 


54 


-2 


54 


0 


79 


0 


Washington 


36 


-1 


36 


1 


66 


-2 


West Virginia 




4 


74 


0 


79 


4 


Wisconsin 


46 


5 


62 


11 


84 


5 


Median 


58 


5 


66 


7 


84 


3 


# of states with 
achievement gains 


22 out of 27 states 


22 out of 27 states 


23 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-8 

Proportion of Students Performing At or Above Their State’s Proficient Level in Eighth-Grade Reading 
in 2006-07, and Change From 2004-05, for Various Racial and Ethnic Groups 




Black 


Hispanic 


White 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


59 


4 


56 


0 


80 


2 


Alaska 


75 


12 


79 


7 


88 


2 


Arizona 


55 


1 


48 


2 


79 


2 


Arkansas 


44 


10 


49 


3 


71 


6 


California 


28 


4 


27 


3 


62 


4 


Colorado 


77 


-1 


74 


1 


93 


0 


Florida 


29 


4 


41 


6 


61 


5 


Illinois 


70 


16 


73 


15 


87 


5 


Indiana 


44 


2 


48 


-4 


73 


1 


Iowa 


46 


-1 


49 


3 


76 


1 


Louisiana 


44 


7 


56 


1 


72 


3 


Maryland 


53 


4 


56 


4 


82 


1 


Mississippi 


37 


-4 


45 


-11 


68 


-5 


Montana 


85 


32 


76 


32 


82 


15 


Nevada 


41 


9 


41 


9 


71 


5 


New Jersey 


49 


1 


56 


1 


83 


0 


New Mexico 


51 


6 


51 


5 


72 


5 


North Carolina 


80 


0 


76 


2 


94 


0 


North Dakota 


53 


-6 


60 


4 


79 


4 


Oklahoma 


61 


9 


63 


6 


83 


4 


Pennsylvania 


50 


13 


50 


12 


81 


11 


South Carolina 


19 


5 


24 


7 


46 


7 


South Dakota 


63 


-5 


57 


3 


82 


-1 


Tennessee 


87 


8 


85 


16 


94 


4 


Texas 


84 


6 


83 


8 


94 


3 


West Virginia 


74 


1 


71 


-5 


81 


0 


Wisconsin 


61 


5 


67 


0 


89 


-1 


Median 


53 


4 


56 


3 


81 


3 


# of states with 
achievement gains 


21 out of 27 states 


22 out of 27 states 


20 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-9 

Proportion of Students Performing At or Above Their State’s Proficient Level in Eighth-Grade Mathematics 
in 2006-07, and Change From 2004-05, for Various Racial and Ethnic Groups 




Black 


Hispanic 


White 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Percent 
Proficient 
in 2006-07 


Change 

From 

2004-05 


Alabama 


52 


7 


58 


1 


75 


2 


Alaska 


59 


19 


67 


12 


78 


6 


Arizona 


47 


4 


48 


4 


76 


3 


Arkansas 


21 


11 


38 


16 


57 


15 


California 


18 


3 


21 


3 


47 


3 


Colorado 


56 


3 


59 


2 


85 


1 


Florida 


42 


5 


57 


4 


75 


4 


Georgia 


74 


18 


76 


18 


89 


9 


Indiana 


43 


2 


55 


0 


77 


0 


Iowa 


45 


0 


54 


1 


79 


1 


Louisiana 


38 


1 


54 


-3 


71 


-1 


Maryland 


36 


5 


44 


4 


74 


7 


Massachusetts 


40 


2 


55 


-4 


69 


1 


Mississippi 


57 


12 


54 


5 


63 


-4 


Montana 


33 


5 


38 


14 


67 


5 


New Jersey 


38 


8 


50 


8 


80 


5 


New Mexico 


23 


6 


23 


6 


48 


8 


North Dakota 


37 


-2 


50 


1 


71 


2 


Oklahoma 


58 


11 


67 


9 


81 


5 


Pennsylvania 


40 


7 


46 


6 


75 


5 


South Carolina 


12 


4 


20 


6 


39 


7 


South Dakota 


52 


6 


51 


6 


77 


3 


Tennessee 


79 


3 


82 


3 


91 


0 


Texas 


61 


13 


65 


14 


83 


7 


Utah 


58 


12 


55 


5 


81 


5 


West Virginia 


57 


4 


62 


0 


72 


1 


Wisconsin 


38 


7 


55 


6 


82 


1 


Median 


43 


5 


54 


5 


75 


3 


# of states with 
achievement gains 


25 out of 27 states 


23 out of 27 states 


23 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-10 

Change in Biack-White and Hispanic-White Achievement Gaps in Fourth-Grade Reading: Difference 
in the Percentage of Students Performing At or Above Their State’s Proficient Level, 2004-05 to 2006-07 




I Black-White Achievement Gap 


1 Hispanic-White Achievement Gap I 


2004-05 


2006-07 


Change in Gap 


2004-05 


2006-07 


Change in Gap 


Alabama 


7 


7 


0 


8 


9 


1 


Alaska 


7 


6 


-1 


6 


7 


1 


Arizona 


13 


12 


-1 


16 


14 


-2 


Arkansas 


15 


15 


0 


9 


12 


3 


California 


16 


16 


0 


17 


17 


0 


Colorado 


7 


9 


2 


9 


10 


1 


Florida 


13 


14 


1 


7 


9 


2 


Indiana 


13 


11 


-2 


11 


11 


0 


Iowa 


12 


13 


1 


11 


10 


-1 


Louisiana 


12 


11 


-1 


4 


5 


1 


Maryland 


10 


8 


-2 


8 


6 


-2 


Massachusetts 


15 


16 


1 


17 


17 


0 


Mississippi 


6 


4 


-2 


5 


4 


-1 


Montana 


0 


2 


2 


8 


6 


-2 


New Jersey 


12 


13 


1 


9 


10 


1 


New Mexico 


13 


12 


-1 


12 


11 


-1 


North Carolina 


9 


8 


-1 


9 


7 


-2 


North Dakota 


7 


6 


-1 


6 


6 


0 


Oklahoma 


9 


6 


-3 


8 


6 


-2 


South Carolina 


13 


15 


2 


11 


13 


2 


South Dakota 


8 


8 


0 


7 


9 


2 


Tennessee 


7 


6 


-1 


10 


6 


-4 


Texas 


9 


8 


-1 


8 


6 


-2 


Utah 


11 


11 


0 


15 


13 


-2 


Washington 


8 


8 


0 


12 


10 


-2 


West Virginia 


4 


3 


-1 


4 


4 


0 


Wisconsin 


13 


13 


0 


12 


12 


0 


Median 


10 


9 


-1 


9 


9 


0 


Number of states with 
gap reduction 


1 3 out of 27 states 


1 2 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-11 

Change in Black-White and Hispanic-White Achievement Gaps in Fourth-Grade Mathematics: Difference 
in the Percentage of Students Performing At or Above Their State’s Proficient Level, 2004-05 to 2006-07 




I Black-White Achievement Gap 


1 Hispanic-White Achievement Gap I 


2004-05 


2006-07 


Change in Gap 


2004-05 


2006-07 


Change in Gap 


Alabama 


19 


18 


-1 


20 


16 


-4 


Alaska 


20 


16 


-4 


16 


12 


-4 


Arizona 


26 


23 


-3 


26 


22 


-4 


Arkansas 


30 


32 


2 


16 


19 


3 


California 


31 


29 


-2 


25 


23 


-2 


Colorado 


16 


14 


-2 


13 


12 


-1 


Florida 


30 


27 


-3 


15 


13 


-2 


Georgia 


20 


18 


-2 


18 


13 


-5 


Indiana 


25 


25 


0 


16 


19 


3 


Iowa 


25 


26 


1 


21 


20 


-1 


Louisiana 


30 


31 


1 


9 


12 


3 


Maryland 


25 


16 


-9 


18 


12 


-6 


Massachusetts 


29 


32 


3 


30 


30 


0 


Mississippi 


20 


18 


-2 


9 


7 


-2 


Montana 


15 


16 


1 


11 


13 


2 


New Jersey 


28 


23 


-5 


18 


17 


-1 


New Mexico 


27 


25 


-2 


24 


22 


-2 


North Dakota 


27 


21 


-6 


13 


12 


-1 


Oklahoma 


27 


19 


-8 


15 


11 


-4 


South Carolina 


31 


34 


3 


23 


25 


2 


South Dakota 


29 


25 


-4 


26 


24 


-2 


Tennessee 


15 


12 


-3 


11 


6 


-5 


Texas 


21 


16 


-5 


14 


11 


-3 


Utah 


23 


25 


2 


25 


24 


-1 


Washington 


30 


30 


0 


32 


30 


-2 


West Virginia 


10 


9 


-1 


2 


6 


4 


Wisconsin 


37 


38 


1 


28 


22 


-6 


Median 


26 


23 


-3 


18 


16 


-2 


Number of states with gap 
reduction 


1 7 out of 27 states 


20 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-12 

Change in Biack-White and Hispanic-White Achievement Gaps in Eighth-Grade Reading: Difference 
in the Percentage of Students Performing At or Above Their State’s Proficient Levei, 2004-05 to 2006-07 




I Black-White Achievement Gap 


1 Hispanic-White Achievement Gap I 


2004-05 


2006-07 


Change in Gap 


2004-05 


2006-07 


Change in Gap 


Alabama 


23 


21 


-2 


22 


24 


2 


Alaska 


22 


13 


-9 


14 


9 


-5 


Arizona 


22 


23 


1 


30 


30 


0 


Arkansas 


31 


28 


-3 


19 


22 


3 


California 


34 


34 


0 


34 


35 


1 


Colorado 


15 


16 


1 


19 


19 


0 


Florida 


31 


32 


1 


21 


20 


-1 


Illinois 


28 


17 


-11 


24 


14 


-10 


Indiana 


30 


29 


-1 


20 


25 


5 


Iowa 


27 


29 


2 


28 


26 


-2 


Louisiana 


33 


28 


-5 


14 


16 


2 


Maryland 


32 


29 


-3 


29 


26 


-3 


Mississippi 


32 


32 


0 


17 


23 


6 


Montana 


15 


-3 


-18 


23 


6 


-17 


Nevada 


33 


30 


-3 


34 


30 


-4 


New Jersey 


36 


34 


-2 


29 


27 


-1 


New Mexico 


22 


21 


-1 


22 


21 


0 


North Carolina 


14 


14 


0 


19 


17 


-2 


North Dakota 


16 


25 


9 


20 


19 


-1 


Oklahoma 


27 


22 


-5 


22 


20 


-2 


Pennsylvania 


34 


31 


-3 


33 


31 


-2 


South Carolina 


26 


27 


1 


23 


23 


0 


South Dakota 


15 


19 


4 


29 


25 


-4 


Tennessee 


12 


8 


-4 


21 


9 


-12 


Texas 


13 


10 


-3 


16 


11 


-5 


West Virginia 


8 


7 


-1 


4 


9 


5 


Wisconsin 


33 


28 


-5 


23 


22 


-1 


Median 


27 


25 


-2 


22 


22 


0 


Number of states with 
gap reduction 


1 7 out of 27 states 


1 6 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-13 

Change in Black-White and Hispanic-White Achievement Gaps in Eighth-Grade Mathematics: Difference 
in the Percentage of Students Performing At or Above Their State’s Proficient Level, 2004-05 to 2006-07 




I Black-White Achievement Gap 


1 Hispanic-White Achievement Gap I 


2004-05 


2006-07 


Change in Gap 


2004-05 


2006-07 


Change in Gap 


Alabama 


29 


23 


-6 


17 


17 


0 


Alaska 


32 


19 


-13 


17 


11 


-6 


Arizona 


30 


29 


-1 


29 


28 


-1 


Arkansas 


32 


35 


3 


20 


19 


-1 


California 


30 


30 


0 


26 


26 


0 


Colorado 


32 


30 


-2 


28 


27 


-1 


Florida 


34 


33 


-1 


18 


18 


0 


Georgia 


23 


15 


-8 


22 


13 


-8 


Indiana 


36 


34 


-2 


22 


22 


0 


Iowa 


33 


34 


1 


24 


24 


0 


Louisiana 


35 


34 


-1 


15 


18 


3 


Maryland 


36 


38 


2 


27 


29 


2 


Massachusetts 


30 


28 


-2 


9 


14 


5 


Mississippi 


22 


6 


-16 


18 


9 


-9 


Montana 


33 


34 


1 


38 


29 


-9 


New Jersey 


45 


42 


-3 


33 


30 


-3 


New Mexico 


23 


25 


2 


23 


25 


2 


North Dakota 


31 


34 


3 


20 


20 


0 


Oklahoma 


29 


23 


-6 


18 


14 


-4 


Pennsylvania 


37 


35 


-2 


30 


28 


-2 


South Carolina 


24 


27 


3 


18 


19 


1 


South Dakota 


29 


26 


-3 


29 


26 


-3 


Tennessee 


16 


12 


-4 


12 


9 


-3 


Texas 


28 


22 


-6 


25 


18 


-7 


Utah 


30 


23 


-7 


26 


26 


0 


West Virginia 


17 


15 


-2 


10 


10 


0 


Wisconsin 


49 


44 


-5 


31 


27 


-5 


Median 


30 


29 


-1 


22 


20 


-2 


Number of states with gap 
reduction 


1 9 out of 27 states 


1 4 out of 27 states 


Source: Consolidated State Performance Reports. 
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Exhibit A-14 

Number of States Showing an Increase in the Proportion of Fourth- and Eighth-Grade Students 
Performing at or Above Their State’s Proficient Level From 2004-05 to 2006-07, by Student Group 



Low-income 



Black 



Hispanic 



White 



LEP 



Migrant 



Students with disabilities 



“All students” group 



Average proportion of 
state subgroups with 
achievement gains 



Grade 4 


Grade 8 


Reading 


Mathematics 


Reading 


Mathematics 


23 out of 27 states 


22 out of 27 states 


25 out of 27 states 


26 out of 27 states 


1 9 out of 27 states 


22 out of 27 states 


21 out of 27 states 


25 out of 27 states 


20 out of 27 states 


22 out of 27 states 


22 out of 27 states 


23 out of 27 states 


1 9 out of 27 states 


23 out of 27 states 


20 out of 27 states 


23 out of 27 states 


20 out of 27 states 


24 out of 27 states 


1 8 out of 27 states 


1 7 out of 27 states 


12 out of 21 states 


17 out of 21 states 


1 6 out of 20 states 


1 4 out of 20 states 


1 9 out of 25 states 


21 out of 25 states 


1 9 out of 25 states 


21 out of 25 states 


20 out of 27 states 


21 out of 27 states 


20 out of 27 states 


24 out of 27 states 


73% 


83% 


78% 


84% 



Source: Consolidated State Performance Reports (»— 30 states). 



Exhibit A-15 

Predicted Percentage of States That Would Reach the Goal of 100 Percent Proficient by 2013-14, for 
Various Student Groups, If Achievement Trajectories From 2004-05 to 2006-07 Continue Through 2013-14 



Lcw-inccme 



Black 



Hispanic 



White 



LEP 



Migrant 



Students with disabilities 



“All students” grcup 



Average proportion of 
student groups predicted 
to reach 100% 



Grade 4 


Grade 8 


Reading 


Mathematics 


Reading 


Mathematics 


3 out of 27 states 


4 out of 27 states 


5 out of 27 states 


3 out of 27 states 


2 out of 27 states 


3 out of 27 states 


5 out of 27 states 


5 out of 27 states 


4 out of 27 states 


6 out of 27 states 


5 out of 27 states 


3 out of 27 states 


5 out of 27 states 


8 out of 27 states 


5 out of 27 states 


3 out of 27 states 


7 out of 27 states 


6 out of 27 states 


4 out of 27 states 


2 out of 27 states 


4 out of 21 states 


5 out of 21 states 


4 out of 20 states 


3 out of 20 states 


4 out of 25 states 


3 out of 25 states 


6 out of 25 states 


3 out of 25 states 


3 out of 27 states 


6 out of 27 states 


4 out of 27 states 


3 out of 27 states 


15 % 


20 % 


18 % 


12 % 



Notes: The average shown at the bottom of each column is based on summing the numerators and denominators reflected in the 
eight cells of that column, and dividing the total of the numerators by the total of the denominators. 

Source: Consolidated State Performance Reports (»=30 states). 
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Exhibit A-16 

Predicted Percentage of Low-Income Students Who Wouid Reach Their State’s Proficient Level in 2013-14, 
in Fourth-Grade Reading, If Achievement Trajectories From 2004-05 to 2006-07 Continue Through 2013-14 



Actual Percent Proficient 



New Mexico 



North Carolina 



North Dakota 



Oklahoma 



South Carolina 



South Dakota 



Tennessee 



Texas 



Utah 



Washington 






Predicted Percent Proficient in 2013-14, 
Assuming Same Rate of Change 




Wisconsin 



Number of states predicted to reach 100% proficient by 2013-14 



3 out of 27 states (1 1 %) 



Note: To calculate the predicted percent proficient in 2013—14, we multiplied the annualized percentage-point change from 2004—05 
to 2006—07 by the number of years remaining to 2013—14 (seven years), and added that figure to the percent proficient in 2006—07. If 
the product was greater than 100 percent, the predicted percent proficient in 2013—14 is 100 percent (since there cannot be more than 
100 percent of students reaching the proficient level). It should be noted that this method assumes no variation in the rate of change. 

Source: Consolidated State Performance Reports. 
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Exhibit A-1 7 

Main NAEP Results in Reading, Mathematics, and Science, 1990 to 2007: 

Average Scale Scores in Fourth Grade for Public School Students by School Poverty Level 
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Exhibit A-18 

Main NAEP Results in Reading, Mathematics, and Science, 1990 to 2007: 
Percent Proficient in Fourth Grade for Public School Students by Race and Ethnicity 
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Exhibit A-19 

Main NAEP Results in Reading, Mathematics, and Science, 1990 to 2007: 

Average Scale Scores in Eighth Grade by School Poverty Level for Public School Students 





* Indicates that the score is significantly different from the 
most recent score (2007 for reading and mathematics and 2005 
for science) (p<.05). 

Note: High-poverty schools were defined as those with 76 to 
100 percent of their students eligible for free or reduced-price 
lunches; in low-poverty schools, 0 to 25 percent were eligible 
for subsidized lunches. 

Source: National Center for Education Statistics, Main NAEP. 
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Percentage of 



Nation 

Alabama 

Alaska 

Arizona 



Arkansas 

California 

Colorado 

Connecticut 

Delaware 

District of Columbia 
Florida 



Georgia 

Hawaii 

Idaho 

Illinois 

Indiana 

Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 



State Trends 
Public School 



Exhibit A-21 

on Main NAEP for Fourth-Grade Reading and Mathematics: 
Students Performing At or Above the NAEP Proficient Level, 2003 i 



Reading 



Mathematics 






Michigan 

Minnesota 

Mississippi 

Missouri 

Montana 

Nebraska 

Nevada 

New Hampshire 
New Jersey 
New Mexico 

New York 

North Carolina 
North Dakota 

Ohio 

Oklahoma 



Rhode Island 

South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 

Vermont 

Virginia 

Washington 

West Virginia 



Wisconsin 

Wyoming 

# with achievement 

gains 

Median change 



39 out of 51 
2 percentage points 



Change 

2 

7 

1 

1 



1 

2 

-1 

-2 

1 

4 

2 



1 

5 

5 

1 

0 

1 

3 

2 

0 

0 



4 

9 



0 

0 

1 

-2 

4 

3 

4 
1 

4 

5 
2 
-4 
3 
2 
1 



-3 

7 



2 

0 

1 

1 

3 
2 

4 
3 
3 
-1 



3 

2 



50 out of 51 
8 percentage points 



Change 

8 

7 

8 
6 



11 

5 

7 

4 

9 

7 

9 



5 

10 

9 

4 

11 

7 
10 

9 

3 

8 



9 

7 



3 
9 

4 
8 

13 

4 

7 

9 

13 

7 

10 

0 

12 

10 

10 



2 

11 



6 

4 
7 

5 

7 

8 

7 

6 

8 
9 



12 

5 



Source: National Center for Education Statistics, Main NAEP (»— 50 states and the District of Columbia). 















Percentage of 



Nation 

Alabama 

Alaska 

Arizona 



Arkansas 

California 

Colorado 

Connecticut 

Delaware 

District of Columbia 
Florida 



Georgia 

Hawaii 

Idaho 

Illinois 

Indiana 

Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 



Maryland 

Massachusetts 



Michigan 

Minnesota 

Mississippi 

Missouri 

Montana 

Nebraska 

Nevada 

New Hampshire 

New Jersey 

New Mexico 

New York 

North Carolina 

North Dakota 

Ohio 

Oklahoma 



State Trends 
Public School 



Exhibit A-22 

on Main NAEP for Eighth-Grade Reading and Mathematics: 
Students Performing At or Above the NAEP Proficient Level, 2003 



Reading 



Mathematics 



Rhode Island 

South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 

Vermont 

Virginia 

Washington 

West Virginia 



Wisconsin 

Wyoming 

# with achievement 

gains 

Median change 



28 out of 51 
1 percentage point 



Change 

1 

-3 

4 

-1 



0 

1 

1 

0 

0 

1 

3 



1 

1 

2 

-2 

-1 

1 

4 

-5 

0 

4 



5 

3 



-3 

2 

-5 

-4 

3 

2 

0 

1 

2 

0 

0 

-1 

3 

1 

-2 



2 

3 



-2 

0 

1 

2 

2 

-1 

3 

0 

1 

-4 



-1 

1 



47 out of 51 
3 percentage points 



to 2007 



Change 

4 
2 
2 

5 



Source: National Center for Education Statistics, Main NAEP (»— 50 states and the District of Columbia). 
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Exhibit A-23 

State Trends on Main NAEP for Fourth-Grade Reading for Various Racial and Ethnic Groups: 
Percentage of Public School Students Performing At or Above the NAEP Proficient Level, 2003 to 2007 



Nation 

Alabama 

Alaska 

Arizona 

Arkansas 

California 

Colorado 

Connecticut 

Delaware 

District of Columbia 

Florida 

Georgia 

Hawaii 

Idaho 

Illinois 

Indiana 

Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 



Montana 

Nebraska 

Nevada 

New Hampshire 

New Jersey 

New Mexico 

New York 

North Carolina 

North Dakota 

Ohio 

Oklahoma 

Oregon 

Pennsylvania 

Rhode Island 

South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 



Vermont 



Virginia 

Washington 

West Virginia 

Wisconsin 

Wyoming 

# with achievement 

gains 

Median change 



Black 

Percent Proficient 
in 2007 

14 

13 

20 

20 

9 

13 

18 

15 

18 

9 

16 

14 

23 



Change 
From 2003 
2 

4 
-1 
7 
-1 
2 
0 
3 
2 
2 
3 
2 

5 



Hispanic 

Percent Proficient 

in 2007 

17 

17 ■ 

17 

13 

16 

U 

15 

16 

24 

15 

28 

21 

21 

15 

18 

17 

18 

19 



Change 
From 2003 
3 




14 


-2 


21 


-2 


11 


-2 


15 


1 


10 


-9 


10 


-5 


13 


4 


15 


5 


10 


-2 


12 


0 


12 


1 


17 


-3 


II ^ 


15 


1 ^ 


8 


-1 


20 


-7 


17 


1 


21 


4 



24 out of 42 
1 percentage point 



23 out of 41 
1 percentage point 



White 

Percent Proficient 
in 2007 

42 

39 

40 

36 

36 

40 

47 

52 

44 

74 

44 

40 

40 

39 

42 

37 

38 

£1 

36 

£1 

36 



Change 
From 2003 

3 
9 
0 
1 
1 

4 
2 
-2 
0 

4 
2 
2 

5 

6 
0 
1 
1 
4 
3 
-3 
0 



Maryland 


17 


3 


21 


-2 


49 


5 


Massachusetts 


19 


4 


18 


3 


56 


8 


Michigan 


12 


4 


19 


3 


39 


-1 


Minnesota 


12 


-2 


16 


0 


42 


-1 


Mississippi 


8 


0 






31 


1 


Missouri 


12 


-2 


22 


-8 


37 


-2 



35 out of 51 
2 percentage points 



Source: National Center for Education Statistics, Main NAEP (»=50 states and the District of Columbia). 
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Exhibit A-24 

State Trends on Main NAEP for Fourth-Grade Mathematics for Various Raciai and Ethnic Groups: 
Percentage of Pubiic School Students Performing At or Above the NAEP Proficient Level, 2003 to 2007 



Nation 

Alabama 

Alaska 

Arizona 

Arkansas 

California 

Colorado 

Connecticut 

Delaware 

District of Columbia 

Florida 

Georgia 

Hawaii 

Idaho 

Illinois 

Indiana 

Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 

Maryland 

Massachusetts 

Michigan 

Minnesota 

Mississippi 

Missouri 

Montana 

Nebraska 

Nevada 

New Hampshire 

New Jersey 

New Mexico 

New York 

North Carolina 

North Dakota 

Ohio 

Oklahoma 

Oregon 

Pennsylvania 

Rhode Island 

South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 

Vermont 

Virginia 

Washington 

West Virginia 

Wisconsin 

Wyoming 

# with achievement 

gains 

Median change 



Black 

Percent Proficient 
in 2007 

15 

10 

22 

16 

12 

15 

20 

15 

20 

8 

15 

13 

24 



Change 
From 2003 
5 
5 
7 

5 

7 

6 

8 
5 
8 
4 

7 
2 

8 



Hispanic 

Percent Proficient 
in 2007 
22 

17 H 

26 

15 

22 

15 

19 

18 

25 

19 

33 

20 

19 

18 

19 

26 

25 

29 



Change 
From 2003 
7 



39 out of 42 
5.5 percentage points 



40 out of 43 
7 percentage points 



White 

Percent Proficient 

in 2007 F 

51 

36 

50 

48 

46 

52 

54 

57 

53 

73 

54 

46 

46 

45 

50 

52 

46 

58 

34 

37 

43 

55 

65 

44 

58 

34 

45 

49 

45 

43 

53 

63 

43 

56 

56 

49 

53 

39 

40 

53 

44 

50 

46 

36 

59 

45 

50 

53 

51 

33 

54 

48 

50 out of 51 



Change 
From 2003 
9 
9 
9 
9 

12 

10 

10 

4 

10 

2 

11 

6 

11 

11 

6 

12 

7 
11 
10 
-2 
9 

11 

16 

1 

11 

4 

10 

15 

6 

11 

10 

12 

10 

11 

1 

12 

11 

10 

4 

9 

4 

4 

8 
6 

10 

10 

8 

7 

11 

9 

11 

6 



10 percentage points 



Source: National Center for Education Statistics, Main NAEP (»=50 states and the District of Columbia). 
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Exhibit A-25 

State Trends on Main NAEP for Eighth-Grade Reading for Various Racial and Ethnic Groups: 
Percentage of Public School Students Performing At or Above the NAEP Proficient Level, 2003 to 2007 



Nation 

Alabama 

Alaska 

Arizona 

Arkansas 

California 

Colorado 

Connecticut 

Delaware 



District of Columbia 

Florida 

Georgia 

Hawaii 

Idaho 

Illinois 

Indiana 

Iowa 

Kansas 



Kentuck 



Louisiana 

Maine 



Maryland 

Massachusetts 

Michigan 

Minnesota 

Mississippi 

Missouri 

Montana 

Nebraska 

Nevada 

New Hampshire 

New Jersey 

New Mexico 

New York 

North Carolina 



North Dakota 



Black 

Percent Proficient 
in 2007 

12 

9 

17 

19 

8 

10 

18 

12 

14 



9 

13 

13 



South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 

Vermont 

Virginia 

Washington 

West Virginia 

Wisconsin 

Wyoming 

# with achievement 

gains 

Median change 



Change 
From 2003 
0 
0 
4 
3 
2 
-2 
2 
0 
1 



1 

2 

1 



Hispanic 

Percent Proficient 
in 2007 

14 

20 ■ 

24 

11 

15 

U 

17 

14 

21 



19 

23 

17 

21 

14 

16 

21 

16 

17 



Change 
From 2003 
0 






1 


1 


12 


-1 


c 


1 


1 


1 |] 


II II 


16 


1 


25 


-6 


16 


-3 


16 


0 


11 


-2 


1 


II" II 


8 


0 


17 


0 



18 out of 41 
0 percentage points 



17 out of 37 
0 percentage points 



White 

Percent Proficient 
in 2007 

38 

29 

36 

37 

32 

34 

43 

46 

41 



Change 
From 2003 
-1 
-1 
0 
1 

-1 

0 

0 

1 

1 



Ohio 


12 


-1 


31 


-6 


42 


3 


Oklahoma 


13 


0 


9 


-8 


31 


-3 


Oregon 


21 


3 


14 


-4 


37 


1 


Pennsylvania 


14 


3 


14 


-10 


41 


5 


Rhode Island 


10 


-5 


6 


-2 


35 


-1 



16 out of 50 
0 percentage points 



Source: National Center for Education Statistics, Main NAEP (»=50 states and the District of Columbia). 
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Exhibit A-26 

State Trends on Main NAEP for Eighth-Grade Mathematics for Various Raciai and Ethnic Groups: 
Percentage of Pubiic School Students Performing At or Above the NAEP Proficient Level, 2003 to 2007 



Nation 

Alabama 

Alaska 

Arizona 

Arkansas 

California 

Colorado 

Connecticut 

Delaware 

District of Columbia 

Florida 

Georgia 



Illinois 

Indiana 

Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 

Maryland 

Massachusetts 

Michigan 

Minnesota 

Mississippi 

Missouri 

Montana 

Nebraska 

Nevada 

New Hampshire 

New Jersey 

New Mexico 

New York 

North Carolina 

North Dakota 

Ohio 

Oklahoma 

Oregon 

Pennsylvania 

Rhode Island 

South Carolina 

South Dakota 

Texas 

Tennessee 

Utah 

Vermont 

Virginia 

Washington 

West Virginia 

Wisconsin 

Wyoming 

# with achievement 

gains 

Median change 



Black 

Percent Proficient 
in 2007 

y 

4 

15 

15 

9 

10 

21 

7 

10 

6 

U 

11 



Change 
From 2003 
4 
1 
4 
8 
6 
4 
12 
0 
2 



Hispanic 

Percent Proficient 
in 2007 

15 

3 H 

23 

12 

8 

10 

13 

10 

17 

9 

21 

16 



Change 
From 2003 
4 



35 out of 41 
3 percentage points 



30 out of 37 
3 percentage points 



White 

Percent Proficient 
in 2007 

£1 

27 

44 

40 

31 

39 

48 

44 

43 



Change 
From 2003 
5 

4 
3 
8 

7 

5 
5 
0 

8 



43 out of 50 
4.5 percentage points 



Source: National Center for Education Statistics, Main NAEP (»=50 states and the District of Columbia). 
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Exhibit A-27 

Number of Title I Schools That Were Identified for Improvement, by State, 1998-99 to 2007-08 



1998-99 


1999-2000 


2000-01 


2001-02 


2003-04 


2004-05 


2005-06 


2006-07 


2007-08 


(n=48) 


(n=49) 


(n=51) 


in=52) 


(n^52) 


(n=52) 


(n=52) 


(n^52) 


(n=52) 



Total 



Alabama 



Alaska 



Arizona 



Arkansas 



California 



Colorado 



Connecticut 



Delaware 



District of Columbia 



Florida 



Georgia 



Hawaii 



Idaho 



Illinois 



Indiana 



Iowa 



Kansas 



Kentucky 



Louisiana 



Maine 



Maryland 



Massachusetts 



Michigan 



Minnesota 



Mississippi 



Missouri 



Montana 



Nebraska 



Nevada 



New Hampshire 



New Jersey 



New Mexico 



New York 



North Carolina 



North Dakota 



Ohio 



Oklahoma 



Oregon 



Pennsylvania 



Puerto Rico 



Rhode Island 



South Carolina 



South Dakota 



Tennessee 



Texas 



Utah 



Vermont 



Virginia 



Washington 



West Virginia 



Wisconsin 



Wyoming 



NR= Not Reported. 

Source: Consolidated State Performance Reports (»=50 states, the District of Columbia, and Puerto Rico). 
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Exhibit A-28 

AYP Targets Missed by Schoois That Did Not Make 
Adequate Yeariy Progress, 2003-04 to 2005-06 
(in 26 States With Data Avaiiabie for Aii Three Years) 



1 00% n 



80 % ^ 



60 % 



40 % ^ 



20% ^ 



0% 




2003-04 



2004-05 



2005-06 



Notes: Schools included in the “Achievement of ‘All Students’ Group” and the "Achievement of Two or More Subgroups" 
segments of the graph may have also missed AYP for test participation or the other academic indicator. However, schools 
included in the "Achievement of a Single Subgroup Only" segment are those that missed AYP for that factor alone and did not 
miss any other AYP targets. “Other” includes schools that missed AYP for combinations of the achievement of a single subgroup, 
test participation, or the other academic indicator, or through a small school analysis. 

Source: Study of State Implementation of Accountability and Teacher Quality Under NCLB (based on data reported by 26 
states for 13,497 schools that missed AYP in 2003—04, for 14,458 schools in 2004—05, and for 14,981 schools in 2005-06). 
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Exhibit A-29 

Percentage of Schools That Missed AYP for Individual Student Subgroups, 
By School Percentage of Minority Students, 2005-06 

25-75% 

Minority 
26% 

7% 

19 % 

22 % 

4% 

21 % 

49% 

36% 

Source: Study of State Implementation of Accountability and Teacher Quality Under 
NCUi (»=81,836 schools, based on data reported by 47 states). 



Exhibit A-30 

Percentage of Elementary Principals Who Reported Changes From 2004-05 to 2006-07 
in the Amount of Instructional Time for Third-Grade Students in Various Subjects 

No Change 
78% 

83% 

88% 

90% 

93% 

91% 

95% 

Source: National Longitudinal Study of NCLB, Principal Survey (»=771 elementary schools). 



Exhibit A-31 

Average Change in Minutes per Week of Instructional Time From 2004-05 to 2006-07 
for Third-Grade Students in Various Subjects, as Reported by Principals 

Identified Schoois 
(n=219) 

-^24 
+40 

+2 

+1 

-1 

+7 

+6 

Source: National Longitudinal Study of NCLB, Principal Survey. 



88 



Non-identified Schoois 
(n=551 ) 

+9 

j^2 

jj 

-2 

J 

0 

0 



Aii Schoois 
(n=771) 



Reading/English/ianguage arts | +10 



Mathematics +24 



Science +1 



Sociai studies -2 



Art/music -1 



Physicai education/heaith 



Other +1 



Decrease in Time 
3% 

4% 

7% 

8% 

5% 

6% 

2% 



Increase in Time 



Reading/English/ianguage arts | 19% 



Mathematics 1 3% 



Science 5% 



Sociai studies 2% 



Art/music 1% 



Physicai education/health 3% 



Other 2% 



75% or More 
Minority 
35% 
20 % 
28% 
50% 
9% 
32% 
65% 
47% 



Less Than 
25% Minority 



African-American 8% 



Asian 6% 



Hispanic 8% 



Native American 9% 



White 2% 



Low-income students 



Students with disabilities 33% 



LEP students 











































































































Exhibit A-32 

Number of Students Participating in Title 1 School Choice and Supplemental Educational Services, 

2003-04 to 2006-07 




School Choice 


Supplemental Educational Services 




2003-04 

(n=43) 


2004-05 

(n=52) 


2005-06 

(n=48) 


2006-07 

(n=50) 


2003-04 

(n=46) 


2004-05 

(n=52) 


2005-06 

(n=51) 


2006-07 

(n=50) 


Total 


31,907 


48,278 


64,668 


119,988 


244,300 


445,652 


497,956 


529,627 


Alabama 


740 


1,018 


1,477 


1,383 


1,616 


1,917 


6,713 


7,481 


Alaska 


26 


200 


103 


47 


475 


513 


766 


895 


Arizona 


149 


32 


140 


1,308 


2,815 


3,177 


4,223 


3,969 


Arkansas 


388 


2,611 


2,615 


399 


3,369 


284 


1,468 


NR 


California 


3,609 


8,509 


12,482 


56,710 


41,198 


98,403 


95,731 


70,110 


Colorado 


368 


364 


876 


1,180 


2,149 


2,993 


3,068 


4,400 


Connecticut 


260 


1,131 


697 


333 


711 


884 


1,402 


3,675 


Delaware 


18 


346 


166 


129 


4 


104 


203 


495 


District of Columbia 


68 


174 


324 


241 


2,814 


2,935 


2,554 


3,926 


Florida 


NR 


6,762 


9,220 


14,905 


NR 


2,461 


23,225 


70,457 


Georgia 


2,547 


3,032 


4,902 


4,558 


24,451 


8,514 


9,670 


10,564 


Hawaii 


157 


693 


358 


559 


2,447 


2,991 


4,353 


4,822 


Idaho 


20 


0 


10 


24 


0 


0 


121 


162 


Illinois 


1,313 


986 


1,048 


2,297 


18,000 


90,320 


50,579 


46,397 


Indiana 


1,199 


1,169 


2,137 


2,743 


3,064 


3,083 


4,022 


5,682 


Iowa 


60 


31 


27 


15 


75 


60 


51 


48 


Kansas 


212 


319 


471 


623 


624 


87 


677 


1,151 


Kentucky 


328 


611 


320 


801 


1,170 


2,061 


3,079 


3,063 


Louisiana 


771 


774 


2,219 


2,397 


1,568 


5,017 


1,861 


4,212 


Maine 


NR 


0 


0 


0 


NR 


23 


50 


76 


Maryland 


914 


1,612 


1,497 


1,373 


5,077 


5,970 


10,718 


1 1 ,693 


Massachusetts 


554 


412 


1,671 


5,008 


6,589 


3,411 


6,430 


7,500 


Michigan 


340 


796 


599 


433 


1 1 ,444 


1 1 ,044 


13,316 


10,909 


Minnesota 


306 


155 


108 


99 


1,498 


2,627 


2,334 


3,150 


Mississippi 


7 


55 


60 


71 


200 


714 


3,573 


2,290 


Missouri 


28 


252 


252 


0 


992 


1,515 


2,844 


4,922 


Montana 


14 


29 


NR 


0 


10 


23 


28 


48 


Nebraska 


0 


0 


0 


0 


0 


0 


0 


0 


Nevada 


252 


817 


1,092 


1,061 


259 


4,984 


5,389 


5,993 


New Hampshire 


1 


22 


22 


120 


15 


77 


97 


355 


New Jersey 


363 


735 


NR 


600 


19,243 


16,400 


NR 


17,566 


New Mexico 


1,656 


2,046 


1,841 


1,903 


3,682 


3,782 


4,656 


3,825 


New York 


7,364 


551 


4,102 


3,692 


67,180 


105,035 


87,814 


64,906 


North Carolina 


337 


2,826 


4,053 


3,228 


362 


666 


6,546 


9,790 


North Dakota 


NR 


0 


0 


0 


118 


197 


205 


251 


Ohio 


1,300 


1,614 


1,994 


2,133 


3,508 


5,012 


7,468 


1 1 ,927 


Oklahoma 


714 


884 


447 


122 


1,467 


1,917 


2,248 


2,305 


Oregon 


873 


402 


652 


2,543 


537 


991 


1,331 


2,031 


Pennsylvania 


NR 


814 


575 


881 


NR 


28,451 


4,213 


4,121 


Puerto Rico 


1,126 


0 


0 


NR 


NR 


10,597 


102,727 


104,095 


Rhode Island 


NR 


161 


34 


51 


4,698 


2,322 


2,402 


2,384 


South Carolina 


NR 


1,447 


925 


2,695 


NR 


3,827 


6,465 


6,887 


South Dakota 


39 


15 


NR 


9 


2,191 


132 


155 


239 


Tennessee 


1,772 


973 


2,412 


2,312 


1,487 


4,053 


4,714 


5,065 


Texas 


NR 


1,031 


1,209 


NR 


45 


25 


1,136 


NR 


Utah 


4 


90 


82 


27 


47 


251 


6 


4 


Vermont 


NR 


0 


NR 


2 


45 


2 


10 


136 


Virginia 


839 


1,111 


922 


666 


4,870 


2,112 


2,526 


2,769 


Washington 


62 


365 


194 


221 


635 


136 


363 


348 


West Virginia 


NR 


65 


93 


81 


NR 


33 


296 


165 


Wisconsin 


432 


197 


197 


3 


1,301 


3,519 


4,103 


2,279 


Wyoming 


377 


39 


43 


2 


250 


0 


27 


89 


Note: “NR” indicates state did not report these data for that year. 












Source: Consolidated State Performance Reports (» 


=50 states, the District of Columbia, and Puerto Rico). 
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Exhibit A-34 

Parents Reporting Various Reasons for Enroiling Their Chiid in Titie 1 Supplemental Services, 
as a Percentage of Participating Parents, in Eight Large Urban Districts, 2006-07 


Tutoring is free. 


53% 


There is tutoring in the subject area(s) in which my chiid needs extra heip. 


51% 


My chiid’s teacher thought he/she shouid get this extra heip. 


48% 


My chiid wanted to get this extra heip. 


35% 


Tutoring is given at a piace that is easy to get to. 


30% 


My chiid got a iow score on a yeariy achievement test. 


29% 


My chiid had been getting bad grades. 


27% 


There is tutoring for chiidren with disabiiities. 


14% 


There is tutoring for chiidren whose first ianguage is not Engiish. 


9% 


My chiid’s schooi is not meeting his/her needs. 


8% 


1 needed after-schooi care. 


8% 


Source: National Longitudinal Study of NCLB, Parent Survey {n—\S7u parents). 
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Exhibit A-35 

Parents Reporting Various Reasons for Not Using the Title 1 School Choice Option, 
as a Percentage of Eligibie Parents Who Did Not Participate, in Eight Large Urban Districts, 2006-07 


1 was satisfied with the quaiity of teaching at my chiid’s schooi. 


63% 


My child’s school is located in a place that is easy to get to. 


60% 


My child wanted to stay. 


45% 


My child was getting good grades at the current school. 


42% 


1 didn’t want to disrupt my child. 


42% 


There is free tutoring or other extra help with schoolwork at my child’s school. 


34% 


There are activities after school and sports teams at my child’s school. 


33% 


There is good discipline, safety, and order at my child’s school. 


28% 


There are services at my child’s school for children whose first language is not 
English. 


25% 


There are different academic programs at my child’s school. 


25% 


There are services at my child’s school for children with disabilities. 


21% 


1 didn’t have enough information about the schools from which 1 could choose. 


13% 


The district did not have transportation to any of the new schools from which 1 could 
choose. 


4% 


1 was not given enough time to make the decision to move my child to another school. 


2% 


Source: National Longitudinal Study of NCLB, Parent Survey (n—220 parents). 



Exhibit A-36 

Parents Reporting Various Reasons for Not Enrolling Their Child in Title 1 Supplemental Services, 
as a Percentage of Eligible Parents Who Did Not Participate, in Eight Large Urban Districts, 2006-07 


My child doesn’t need help. 


46% 


Tutoring is given at times that are not good for my family. 


35% 


Tutoring is given at a place that is not easy to get to. 


15% 


My child did not want to get this extra help. 


13% 


There is no tutoring in the subject areas where my child needs extra help. 


11% 


Tutoring does not meet the needs of children whose first language is not English. 


3% 


Tutoring does not meet the needs of children with disabilities. 


2% 


There is no tutoring at my child's grade level. 


1% 


Source: National Longitudinal Study of NCLB, Parent Survey 125 parents). 
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Exhibit A-37 

Achievement Effects of Student Participation in 
Title I Supplementai Educational Services in Seven Districts 




Mathematics 


Reading 


n 


Effect Size 


n 


Effect Size 


16,127 


.04* 


16,207 


.06* 


342 


.04 


991 


.03 


22,757 


.03* 


22,757 


.03* 


5,650 


.06* 


5,972 


.08* 


3,732 


.12 * 


3,659 


.07 * 


1,001 


.38* 


965 


.58* 


1,124 


-.002 


1,096 


.03 



District A 



District B 



District C 



District D 



District E 



District F 



District H 



* Indicates significance at the 5 percent level. 

Source: National Longitudinal Study of NCLB, Analysis of Title 1 Choice Options in Nine Urban Districts. 



Exhibit A-38 

Achievement Effects of Student Participation in 
Title I School Choice in Six Districts 




Mathematics 


Reading 


N 


Effect Size 


n 


Effect Size 


646 


.03 


648 


.02 


305 


-.01 


769 


-.02 


312 


.01 


312 


.09 


799 


-.01 


845 


.07 


721 


-.16* 


740 


-.01 


645 


-.03 


675 


-.01 



District A 



District B 



District C 



District D 



District E 



District G 



* Indicates significance at the 5 percent level. 

Source: National Longitudinal Study of NCLB, Analysis of Title 1 Choice Options in Nine Urban Districts. 
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Exhibit A-39 

State Definitions of Highiy Quaiified Teacher: Use of Praxis II Exams and Cut Scores, November 2007 




State Uses At Least One 
Exam from Praxis II 
Series for Some/All 
Teachers 


Praxis II: Elementary 
Education Content 
Knowledge 


Praxis II: English Language, 
Literature and Composition: 
Content Knowledge 


Praxis II: 
Mathematics 
Content 
Knowledge 


Total Number of States 
Using Praxis li Subject 
Assessments 


40 


26 


36 


36 


Alabama 


X 


137 


151 


126 


Alaska 


X 


143 


158 


146 


Arkansas 


X 




159 


116 


Colorado 


X 


147 


162 


156 


Connecticut 


X 




172 


137 


Delaware 


X 


151 


163 


141 


District of Columbia 


X 


145 


142 


141 


Hawaii 


X 




164 


136 


Idaho 


X 


143 


158 


119 


Indiana 


X 




153 


136 


Iowa 


X 


142 






Kansas 


X 




165 


137 


Kentucky 


X 


148 


160 


125 


Louisiana 


X 


150 


160 


130 


Maine 


X 


145 


160 


126 


Maryland 


X 


142 


164 


141 


Minnesota 


X 


145 


157 


125 


Mississippi 


X 


153 


157 


123 


Missouri 


X 




158 


137 


Montana 


X 


Composite with 
other factors 






Nebraska 


X 








Nevada 


X 




150 


133 


New Hampshire 


X 


148 


164 


127 




X 


141 


162 


137 


North Carolina 


X 




Composite with other tests I 


North Dakota 


X 




151 


139 


Ohio 


X 


143 


167 


139 


Oregon 


X 




159 


139 


Pennsylvania 


X 




160 


136 


Rhode Island 


X 


145 






South Carolina 


X 




162 


131 


South Dakota 


X 


140 


154 


124 


Tennessee 


X 


140 


157 


136 


Utah 


X 


150 


168 


138 


Vermont 


X 


148 


172 


141 


Virginia 


X 


143 


172 


147 


Washington 


X 


141 


158 


134 


West Virginia 


X 




155 


133 


Wisconsin 


X 


147 


160 


135 


Wyoming 


X 


160 


* 


* 


National Median Score 


164 


178 


144 


Range from 25’" to 75’" Percentile 


152-176 


167-188 


129-159 


Range from 10’" to 90’" Percentile 


141-185 


155-196 


113-173 


Source: Educational Testing Service (»=41 states and the District of Columbia). 

* Test required but passing score not set. 

Notes: Cut scores were obtained from the Educational Testing Service publication, The Praxis Series Passing Scores kg Test and State, found on 
the ETS Web site in January 2008 (www.ets.org/Media/Tests/PRAXlS/pdf/09706passingscores.pdf). Percentile scores were provided by 
the Educational Testing Service on Sept. 7, 2007. 
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Exhibit A-40 

Change in Teacher Participation in Professional Development Focused on 
In-Depth Study of Topics in Reading and Mathematics, 2003-04 to 2005-06 



Elementary Teachers Secondary English and Mathematics Teachers 




2003-04 2005-06 2003-04 2005-06 2003-04 2005-06 2003-04 2005-06 

Reading Mathematics Engiish Mathematics 



Source: National Longitudinal Study of NCLB, Teacher Survey. 
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APPENDIX B: STANDARD ERROR TABLES 



In the following tables, standard errors are provided in parentheses after each estimate. 



Exhibit B-1 : Standard Errors for Exhibit 6 
Main NAEP Resuits in Reading, Mathematics, and Science, 1990 to 2005: 
Average Scale Scores by School Grade Level for Public School Students 




4th Grade 


8th Grade 


12th Grade 


Reading 


1992 


215 (1.0) 


258 (1.0) 


290 (0.7) 


1994 


212 (1.1) 


257 (0.8) 


286 (0.7) 


1998 


213 (1.2) 


261 (0.8) 


289 (0.7) 


2000 


211 (1.4) 






2002 


217(0.5) 


263 (0.5) 


285 (0.7) 


2003 


216 (0.3) 


261 (0.2) 




2005 


217 (0.2) 


260 (0.2) 


285 (0.7) 


2007 


220 (0.x) 


261 (0.x) 




Mathematics 


1990 


212 (1.1) 


262 (1.4) 


294 (1.2) 


1992 


219 (0.8) 


267(1.0) 


297 (1.0) 


1996 


222 (1.1) 


269 (1.0) 


303 (0.9) 


2000 


224 (1.0) 


272 (0.9) 


300 (1.1) 


2003 


234 (0.2) 


276 (0.3) 




2005 


237 (0.2) 


278 (0.2) 




2007 


239 (0.x) 


280 (0.x) 




Science 


1996 


145 (1.2) 


148 (0.9) 


150 (0.8) 


2000 


145 (1.1) 


148 (1.1) 


145 (1.0) 


2005 


149 (0.3) 


147 (0.3) 


146 (0.6) 


Source: National Center for Education Statistics, Main NAEP. 
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Exhibit B-2: Standard Errors for Exhibit A-17 
Main NAEP Resuits in Reading, Mathematics, and Science, 1990 to 2007: 

Average Scale Scores in Fourth Grade by School Poverty Level for Public School Students 




Reading 



1992 



1994 



1998 



2000 



2002 



2003 



2005 



2007 



High-Poverty Schools 
(76-100% Eligible for Free 
or Reduced-Price Lunches) 



192 (3.0) 



182 (3.2) 



187 (3.1) 



183 (2.8) 



196 (0.7) 



194 (0.5) 



197 (0.4) 



Low-Poverty Schools 
(0-25% Eligible for Free 
or Reduced-Price Lunches) 



225 (1.7) 



225 (1.7) 



230 (1.5) 



230 (1.7) 



233 (0.5) 



232 (0.5) 



233 (0.3) 



Mathematics 


1990 


194 (4.2) 


218 (2.0) 


1992 


195 (2.8) 


230 (1.4) 


1996 


209 (2.7) 


235 (1.5) 


2000 


205 (1.2) 


239 (1.4) 


2003 


216 (0.5) 


247 (0.3) 


2005 


221 (0.3) 


251 (0.3) 


2007 


222 (0.4) 


253 (0.3) 


Science 


1996 


131 (2.9) 


162 (1.4) 


2000 


117 (2.2) 


162 (1.3) 


2005 


127 (0.5) 


165 (0.3) 


Source: National Center for Education Statistics, Main NAEP, unpublished tabulations. 
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Exhibit B-3: Standard Errors for Exhibit 7 
Main NAEP Resuits in Reading, Mathematics, and Science, 1990 to 2005: 
Average Scale Scores in Fourth Grade by Race and Ethnicity for Pubiic School Students 



Hispanic 



Reading 



1992 



1994 


184 (1.8) 


186 (3.6) 


222 (1.3) 


1998 


192 (2.1) 


192 (3.2) 


223 (1.1) 


2000 


189 (1.9) 


188 (3.1) 


223 (1.2) 


2002 


198 (0.6) 


199 (1.4) 


227 (0.3) 


2003 


197 (0.4) 


199 (0.6) 


227 (0.2) 


2005 


199 (0.3) 


201 (0.5) 


228 (0.2) 


2007 


203 (0.4) 


204 (0.5) 


230 (0.2) 


Mathematics 


1990 


187 (1.9) 


199 (2.4) 


219 (1.1) 


1992 


192 (1.4) 


201 (1.7) 


227 (0.9) 


1996 


198 (1.6) 


207 (1.9) 


231 (1.1) 


2000 


203 (1.2) 


207 (1.5) 


233 (0.9) 


2003 


216 (0.4) 


221 (0.4) 


243 (0.2) 


2005 


220 (0.3) 


225 (0.3) 


246 (0.2) 


2007 


222 (0.3) 


227 (0.3) 


248 (0.2) 


Science 


1996 


119 (1.4) 


122 (3.1) 


157 (1.0) 


2000 


121 (1.1) 


121 (2.3) 


158 (0.8) 


2005 


128 (0.6) 


132 (0.5) 


161 (0.3) 


Source: National Center for Education Statistics, Main NAEP. 
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Exhibit B-4: Standard Errors for Exhibit 8 
Main NAEP Resuits in Reading, Mathematics, and Science, 1990 to 2005: 
Average Scaie Scores in Eighth Grade by Race and Ethnicity for Public School Students 



Hispanic 



Reading 



1992 



1994 


235 (1.8) 


239 (1.6) 


265 (1.0) 


1998 


242 (1.2) 


241 (1.7) 


268 (1.0) 


2002 


244 (0.8) 


245 (0.8) 


271 (0.5) 


2003 


244 (0.5) 


244 (0.7) 


270 (0.2) 


2005 


242 (0.4) 


245 (0.4) 


269 (0.2) 


2007 


244 (0.4) 


246 (0.4) 


270 (0.2) 


Mathematics 


1990 


236 (2.8) 


245 (4.4) 


269 (1.4) 


1992 


236 (1.3) 


247 (1.2) 


276 (1.1) 


1996 


239 (1.9) 


249 (1.9) 


279 (1.2) 


2000 


243 (1.3) 


252 (1.4) 


283 (0.9) 


2003 


252 (0.5) 


258 (0.6) 


287 (0.3) 


2005 


254 (0.4) 


261 (0.4) 


288 (0.2) 


2007 


259 (0.4) 


264 (0.4) 


290 (0.2) 


Science 


1996 


120 (1.0) 


126 (2.9) 


158 (0.8) 


2000 


120 (1.4) 


125 (1.4) 


158 (0.9) 


2005 


123 (0.4) 


120 (0.5) 


159 (0.3) 


Source: National Center for Education Statistics, Main NAEP. 
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Exhibit B-5: Standard Errors for Exhibit 23 
Percentage of Identified Title I Schools Experiencing Various Types of Interventions 
Since Identification for Improvement, 2006-07 

Percent of Percent of Percent of Percent of 

Schools in Schools in Schools in Schools in 

Year 1 of Year 2 of Corrective Restructuring 
Improvement Improvement Action 

(n=102) (n=63) (n=99) (n=163) 



Actions Required for All Identified Schools 



Parents were notified ef schoels' improvement 
status 


94.3 (3.3) 


100.0 (0.0) 


100.0 (0.0) 


95.9. (2.3) 


District or state developed a joint improvement 
plan with the school 


82.7 (5.8) 


95.9 (2.4) 


94.1 (2.7) 


85.8 (7.1) 


Students were effered the option to transfer to a 
higher-performing school, with transportation 
provided 


70.9 (9.6) 


80.1 (11.1) 


85.3 (7.4) 


90.7 (3.5) 


Action Required for Identified Schools That Miss AYP After Identification 


Eligible students were offered supplemental 
educational services from a state-approved 
provider 


52.8 (10.0) 


92.0 (4.8) 


100.0 (0.0) 


94.2 (4.3) 


Corrective Actions 


Implemented a new research-based curriculum or 
instructional program 


53.7 (9.8) 


60.3 (11.9) 


67.0 (9.5) 


80.8 (5.8) 


Significantly decreased management authority at 
the school level 


3.9 (2.3) 


16.7 (8.8) 


1.5 (0.7) 


13.3(3.8) 


Appointed eutside expert to advise the school 


34.4 (8.5) 


35.2 (10.8) 


25.6 (6.1) 


52.8 (6.4) 


Extended length of school day 


14.8 (4.9) 


26.4 (9.5) 


22.0 (9.8) 


43.7 (6.7) 


Extended length of school year 


6.2 (3.2) 


6.9 (4.1) 


8.8 (4.1) 


16.2 (4.4) 


Restructured internal organization of the scheel 


10.4 (4.2) 


11.9 (6.3) 


20.8 (7.3) 


39.4 (6.3) 


Replaced scheol staff members relevant to 
school's low performance 


4.2 (2.2) 


10.9 (7.0) 


20.8 (8.1) 


29.9 (6.4) 


Replaced the principal * 


13.3 (4.7) 


24.3 (8.1) 


29.5 (8.2) 


40.2 (6.6) 


Restructuring Interventions 


Reopened the scheol as a public charter school 


1.8 (1.8) 


7.3 (6.9) 


0.0 (0.0) 


0.7 (0.6) 


Entered inte a contract with a private entity to 
manage the schoel 


1.8 (1.8) 


1.5 (1.5) 


0.0 (0.0) 


1.3 (0.8) 


Operation of school turned ever te state 


1.8 (1.8) 


2.2 (2.1) 


0.1 (0.1) 


3.0 (1.4) 


Replaced all or most of the school staff 


5.0 (2.7) 


10.7 (7.4) 


4.4 (2.7) 


12.1 (4.0) 



* Replacing the principal is not a mandated intervention for schools in corrective action, but the principal may be thought of as the 
staff person responsible for the school’s performance, so replacing the principal was included as a separate item on the survey. 

Source: National Longitudinal Study of NCLB, Principal Survey. 
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Exhibit B-6: Standard Errors for Exhibit 25 
Percentage of Districts Taking Various Actions in Response to 
Being Identified for Improvement, 2006-07 


Offered/required specific professional development for teachers 


91.2 (4.8) 


Increased district monitoring of Instruction and student performance at school sites 


84.7 (6.5) 


Offered/required specific professional development for principals 


70.1 (9.4) 


Reallocated fiscal resources to target specific needs (e.g., particular groups of students, 
subjects, or schools) 


64.4 (8.9) 


Developed or revised district content standards 


39.4 (9.9) 


Distributed test preparation materials to some or all sohools 


48.6 (8.9) 


Implemented a district-wide curriculum in reading 


39.6 (8.0) 


Hired a consultant to advise distrlot administrators on effective strategies 


35.8 (9.3) 


Implemented a district-wlde curriculum In mathematics 


32.3 (7.4) 


Reorganized the district office staff to increase efficiency or foous on instruction 


29.0 (7.0) 


Changed the budget allocation formula for schools 


21.4 (6.2) 


Implemented new personnel procedures for hiring or assigning principals and teachers 


22.5 (6.9) 


Created smaller schools, or schools-within-schools 


12.3 (4.7) 


Source: National Longitudinal Study of NCLB, District Survey (n—9S districts). 
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Exhibit B-7: Standard Errors for Exhibits 28 and A-33 
Parents Reporting Various Reasons for Using the Title I School Choice Option, 
as a Percentage of Participating Parents, in Eight Large Urban Districts, 2004-05 and 2006-07 



The quality of teaching at the new school was better 



My child's old school was not meeting his/her needs 



There is good discipline, safety, and order at the new school 



My child got transportation to the new school 



The new school is located in a place that is easy to get to 



There are different academic programs at the new school 



My child wanted to change schools 



There are activities after school and sports teams at the new school 



There is free tutoring or other extra help with schoolwork at the new school 



My child had been getting bad grades 



There are services for children with disabilities at the new school 



My child's old teacher thought he/she should move 



There are services at the school for children whose first language is not English 



Source: National Longitudinal Study of NCLB, Parent Survey (»— 356 parents in 2004—05; 282 



2004-05 


2006-07 


52.2 (3.2) 


62.4 (3.1) 


47.1 (3.2) 


62.0 (3.1) 


49.4 (3.2) 


46.9 (3.2) 


34.8 (2.8) 


34.6 (3.0) 


33.7 (3.2) 


30.3 (2.9) 


28.6 (2.8) 


30.0 (3.0) 


25.3 (2.7) 


28.0 (2.8) 


19.8(2.4) 


24.0 (2.7) 


18.9 (2.4) 


20.2 (2.6) 


17.1 (2.1) 


19.3 (2.5) 


11.0 (1.9) 


11.8 (2.0) 


9.6 (1.4) 


10.9 (1.9) 


4.8 (1.3) 


4.8 (1.4) 



parents in 2006-07). 



Exhibit B-8: Standard Errors for Exhibits 28 and A-34 
Parents Reporting Various Reasons for Enrolling Their Child in Title I Supplemental Services, 
as a Percentage of Participating Parents, in Eight Large Urban Districts, 2004-05 and 2006-07 



2004-05 



2006-07 



Tutering is free 


57.9 (3.5) 


52.8 (4.5) 


There is tutoring in the subject area(s) in which my child needs extra help 


60.3 (3.5) 


50.8 (4.5) 


My child's teacher thought he/she should get this extra help 


51.7 (3.6) 


48.1 (4.5) 


My child wanted to get this extra help 


43.1 (3.5) 


34.7 (4.1) 


Tutering is given at a place that is easy to get to 


47.0 (3.6) 


30.2 (4.0) 


My child got a low score en a yearly achievement test 


33.2 (3.4) 


29.0 (4.0) 


My child had been getting bad grades 


26.9 (3.2) 


26.9 (4.0) 


There is tutoring for children with disabilities 


10.9(2.3) 


13.5 (2.9) 


There is tutoring for children whese first language is not English 


6.3 (1.8) 


8.9 (2.8) 


1 needed after-school care 


11.6 (2.4) 


8.1 (2.2) 


My child's schcci is net meeting his/her needs 


18.3 (2.8) 


7.8 (2.2) 


Source: National Longitudinal Study of ATCLB, Parent Survey (n—260 parents in 2004—05; 452 parents in 2006—07). 
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Exhibit B-9: Standard Errors for Exhibits 28 and A-35 
Parents Reporting Various Reasons for Not Using the Title I School Choice Option, as a Percentage of 
Eligible Parents Who Did Not Participate, in Eight Large Urban Districts, 2004-05 and 2006-07 



I was satisfied with the quality of teaching at my child’s school 



My child’s school is looated in a place that is easy to get to 



My child wanted to stay 



My child was getting good grades at the current school 



I didn’t want to disrupt my child 



There is free tutoring or other extra help with schoolwork at my child’s school 



There are activities after school and sports teams at my child’s school 



There is good discipline, safety, and order at my child’s school 



There are services at my child’s school for children whose first language is not English 



There are different academic programs at my child’s school 



There are services at my child’s school for children with disabilities 



I didn’t have enough information about the schools I could ohoose from 



There was no space for my child at the school I wanted 



The distriot did not have transportation to any of the new schools 1 could choose from 



I was not given enough time to make the decision to move my child to another school 



NA — Not applicable (this response category was not included in the 2004—05 parent survey). 

Source: National Longitudinal Study of NCUi, Parent Survey (»=217 parents in 2004—05; 220 parents in 2006—07) 



2004-05 


2006-07 


46.7 (6.2) 


63.0 (5.8) 


75.2 (5.4) 


60.3 (6.1) 


49.6 (6.2) 


44.8 (6.1) 


47.4 (6.2) 


42.4 (6.1) 


42.1 (6.2) 


41.5 (6.1) 


26.5 (5.3) 


33.8 (5.7) 


27.4 (5.5) 


33.3 (5.9) 


33.9 (6.0) 


28.1 (5.2) 


9.2 (3.3) 


25.4 (5.8) 


21.6(5.3) 


25.1 (5.3) 


19.7 (4.9) 


21.2 (5.3) 


22.9 (5.0) 


12.5 (4.2) 


NA 


4.8 (2.7) 


18.4 (5.0) 


4.4 (1.5) 


17.2 (5.2) 


2.0 (1.0) 



Exhibit B-10: Standard Errors for Exhibits 28 and A-36 
Parents Reporting Various Reasons for Not Enrolling Their Child in Title I Supplemental Services, as a 
Percentage of Eligible Parents Who Did Not Participate, in Eight Large Urban Districts, 2004-05 and 2006-07 



My child doesn’t need help 



Tutoring is given at times that are not good for my family 



Tutoring is given at a place that is not easy to get to 



My child did not want to get this extra help 



There is no tutoring in the subject areas where my child needs extra help 



Tutoring does not meet the needs of children whose first language is not English 



Tutoring does not meet the needs of children with disabilities 



There is no tutoring at my child’s grade level 



Source: National Longitudinal Study of NCUi, Parent Survey (»— 52 parents in 2004—05; 125 parents in 2006—07) 



2004-05 


2006-07 


27.6 (7.2) 


45.6 (7.4) 


46.5 (10.2) 


34.6 (6.9) 


12.1 (7.2) 


15.2 (4.9) 


11.8 (7.0) 


13.3 (5.5) 


4.8 (2.9) 


10.5 (5.0) 


<1 (.) 


3.4 (3.3) 


5.3 (4.5) 


2.3 (1.3) 


5.2 (3.3) 


0.8 (0.4) 
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Exhibit B-11 : Standard Errors for Exhibit 29 
District Strategies for Communicating With Parents 
About Title I School Choice and Supplemental Services Options, 2004-05 and 2006-07 




2006-07 



Written notification in Engiish 



Written notification in ianguage(s) other than English 



Enrollment fairs or open houses 



Individual meetings with interested parents 



Notices in district or school newsletters 



Public service announcements 



Worked with a local community 



Notices in public newspapers 



Notices on school district’s website 



Instructed principals to inform parents of availability of services 



Provided information during regularly scheduled parent-teacher 
conferences 



2004-05 



Written notification in English 



Written notification in language(s) other than English 



Individual meetings with interested parents 



Notices in district or school newsletters 



Notices in public newspapers 



Enrollment fairs or open houses to provide information 
about alternate schools and providers 



Public service announcements 



Working with a local community partner 

(e.g., Parent Information and Resource Center) 



Other 



Source: National Longitudinal Study of NCLB, District Survey. 



School Choice 


Supplemental Services 


Percent of 
districts 


Percent of 
students 


Percent of 
districts 


Percent of 
students 



98.7 (1.3) 



59.4 (8.3) 



22.5 (5.4) 



60.5 (8.6) 



53.3 (8.6) 



14.9 (4.6) 



16.8 (5.4) 



25.6 (6.5) 



24.4 (6.2) 



92.2 (0.8) 



73.7 (4.8) 



46.5 (5.0) 



73.0 (4.6) 



66.9 (4.9) 



26.1 (4.0) 



31.0 (4.4) 



35.0 (4.6) 



53.4 (5.2) 




(n=146 districts) 



91.3 (5.4) 


97.7(1.1) 


6.9 (8.4) 


82.6 (4.0) 


62.9 (9.2) 


81.8 (2.7) 


62.8 (9.4) 


82.6 (3.7) 


49.5 (9.4) 


63.1 (4.3) 


30.8 (9.8) 


42.1 (4.9) 


33.0 (9.6) 


40.4 (4.9) 


12.7(4.6) 


37.0 (4.8) 


30.8 (7.0) 


63.0 (4.9) 


79.1 (7.0) 


91.4 (3.1) 


60.7 (9.4) 


71.9 (5.1) 


(n=129 districts) 



67.9 (9.9) 


87.9 (3.7) 


94.0 (5.9) 


94.2 (3.8) 


47.0 (9.6) 


63.9 (3.7) 


52.9 (5.9) 


71.6 (3.8) 


51.7(9.2) 


67.8 (3.8) 


78.3 (8.6) 


78.7 (5.5) 


39.7 (8.6) 


58.7 (4.3) 


64.2 (9.9) 


71.7(5.7) 


26.0 (7.4) 


45.0 (4.4) 


23.4 (9.0) 


48.2 (6.2) 


19.2 (5.2) 


41.7 (4.5) 


51.4 (11.1) 


70.8 (5.6) 


10.0 (3.3) 


31.7 (4.5) 


19.1 (5.6) 


40.6 (5.9) 


10.1 (4.0) 


20.1 (2.6) 


16.2 (7.4) 


40.4 (5.9) 


11.8 (4.1) 


22.0 (3.2) 


26.0 (8.2) 


30.5 (5.6) 


(n=156 districts) 


(n=109 districts) 
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Exhibit B-13: Standard Errors for Exhibit 34 




Percentage of Teachers Reporting That They Were Considered 




Highly Qualified Under NCLB, 2004-05 and 2006-07 






n 


Highly Qualified 


Not Highly Qualified 


Don’t Know 


2006-07 


Elementary teachers 


4,121 


84.9 (1.3) 


1.5 (0.3) 


13.7(1.3) 


Secondary English teachers 


1,826 


84.0 (1.7) 


2.6 (0.4) 


13.4(1.6) 


Secondary math teachers 


1,727 


79.3 (2.0) 


4.4 (0.9) 


16.2 (2.0) 


Special education teachers 


1,137 


72.1 (2.4) 


10.0 (2.1) 


12.8(1.7) 


2004-05 


Elementary teachers 


4,059 


75.1 (1.8) 


2.1 (0.3) 


22.9 (1.8) 


Secondary English teachers 


1,787 


73.7 (2.2) 


5.8 (0.9) 


20.4 (2.2) 


Secondary math teachers 


1,627 


67.9 (2.6) 


8.0 (1.2) 


24.1 (2.5) 


Special education teachers 


1,158 


52.3 (2.4) 


14.5 (2.2) 


29.2 (2.3) 


Source: National Longitudinal Study of NCL.B, Teacher Survey. 
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Exhibit B-14: Standard Errors for Exhibits 35 and 36 
Percentage of Teachers Participating in Professional Development Focused on 
Instructional Strategies for Reading and Mathematics, 2003-04 and 2005-06 




Professional Development in 
Teaching Reading 



Professional Development in 
Teaching Mathematics 



2005-06 



More than 24 hours 



6 to 24 hours 



1 to 5 hours 



None 



2003-04 



More than 24 hours 



6 to 24 hours 



1 to 5 hours 



None 



Source: National Longitudinal Study oiNCLB, Teacher Survey. 



Elementary 

Teachers 


Secondary Elementary 

English Teachers 

Teachers 


Secondary 

Mathematics 

Teachers 




26.3 (1.6) 


25.7(2.0) 11.4(1.3) 


21.6 (1.7) 


41.4 (1.3) 


39.7(2.4) 33.0(1.7) 


36.6 (2.1) 


23.9 (1.2) 


25.6(2.2) 34.7(1.9) 


28.7 (2.3) 


8.4 (0.9) 


9.0 (1.3) 20.9(1.6) 


13.1 (1.6) 


(n=4,047) 


(n=1,790) (n=4,043) 


(n=1,699) 



19.6 (1.3) 


21.9 (1.8) 




9.1 (0.9) 


16.1 (1.6) 


38.9 (1.3) 


35.5 (1.8) 




25.6 (1.2) 


30.4 (2.1) 


31.2 (1.9) 


30.3 (2.0) 




36.7(1.6) 


30.9 (2.5) 


10.4(1.3) 


12.2 (1.3) 




28.6 (1.9) 


22.6 (2.1) 


(n=4,007) 


(n=1,740) 




(n=3,994) 


(n=1,580) 



Exhibit B-15: Standard Errors for Exhibits 35 and A-40 
Percentage of Teachers Participating in Professional Development Focused on 
In-Depth Study of Topics in Reading and Mathematics, 2003-04 and 2005-06 




2005-06 



More than 24 hours 



6 to 24 hours 



1 to 5 hours 



None 



2003-04 



More than 24 hours 



6 to 24 hours 



1 to 5 hours 



None 



Professional Development in 
Teaching Reading 



Professional Development in 
Teaching Mathematics 



Elementary 

Teachers 


Secondary Elementary 

English Teachers 

Teachers 


Secondary 

Mathematics 

Teachers 




14.4 (1.1) 


16.2(1.7) 6.0 (0.9) 


14.9 (1.7) 


29.6 (1.3) 


28.9(2.2) 19.4(1.5) 


19.3 (1.9) 


28.0 (1.3) 


28.3(1.7) 27.8(1.3) 


27.8 (2.2) 


28.0 (1.6) 


26.6(2.4) 46.7(1.7) 


38.0 (2.6) 


(n=4,007) 


(n=1,776) (n=3,980) 


(n=1,694) 



12.8 (1.0) 


15.9 (1.8) 




6.2 (0.8) 


10.4 (1.2) 


28.0 (1.3) 


23.6 (1.6) 




13.6 (1.1) 


15.4 (1.7) 


32.4 (1.2) 


30.4 (2.0) 




29.1 (1.3) 


25.5 (1.8) 


26.8 (1.3) 


30.1 (2.2) 




51.0 (1.7) 


48.7 (2.4) 


(n=3,982) 


(n=1,719) 




(n=3,950) 


(n=1,565) 



Source: National Longitudinal Study of NCLB, Teacher Survey. 
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